The 30 Rock star was also reportedly not carrying ID on him at the time of his arrest, and was brought to a police station so he could be properly identified.
Baldwin was ticketed for illegal biking as well as disorderly conduct, because he was "belligerent" with officers while in custody, according to TMZ.
He addressed the incident on Twitter Tuesday afternoon, writing: "Officer Moreno, badge number 23388, arrested me and handcuffed me for going the wrong way on Fifth Ave. Meanwhile, photographers outside my home ONCE AGAIN terrified my daughter and nearly hit her with a camera. The police did nothing."
"New York City is a mismanaged carnival of stupidity that is desperate for revenue and anxious to criminalize behavior once thought benign," he later added.