This has been a big topic in the media recently, what to call the previous decade. They seem to mostly have settled on "the aughts" (aught is another word for zero.) When people talk about the 1900-1909 period it's often referred to vaguely as "around the turn of the century."
The next decade will likely been called "the teens".