Baldwin was born in Massapequa,
New York, the youngest son of Carol Newcomb (née Martineau) and Alexander Rae Baldwin, Jr., a high school social studies teacher and football coach. Baldwin's elder brothers are actors Alec, Daniel, and William, collectively known as the "Baldwin brothers".