As you've probably suspected, it really is all bullshit. There is no ultimate authority to which we must defer (with whom we presently have any objectively provable contact), and that basically, you're it. Tag, muthafucka.
Of course, if you're not stupid, you also realize that the resultant corollary of this argument is that society is a complete construct of human invention, and thus subject to the whims of people... and people are unpredictable as fuck.
This is probably the reason why so many still cling to the belief in some vague divine benevolence, like at least deism, less often literally theistic than people think (which requires a conscious and personality-having god that directly intervenes in people's lives... I mean, it's obviously not impossible but not even most religious people go that far). And it's probably a good thing, we bitter atheists have to acknowledge (which, I must remind myself so often, only means "lack of belief in theism," and is oddly not actually mutually exclusive with deism, categorically speaking).
Who is adeistic, though? It seems that the claim to certainty that there isn't some unknowable, unnamable order which inevitably sorts out loose ends, and somehow provides a framework where everything turns out okay for as many people who want everyone else to also be happy (boy that's a hard one to parse) is just as logically absurd as any other claim that there is (though claiming to know the name of this magical thing as well does seem to be statistically improbable to a far greater degree...).
Fuck, man. No one knows.
Now, how can that not be the greatest unifying force in the universe? How can we not all band together and recognize that we are simple, lovable little creatures when compared to whatever vastly superior intelligence would have to organize the absurdly ironic chaos that forms our lives...