Lil Baby just got arrested by police in Georgia who hauled him out of his car on a highway to slap the cuffs on him … TMZ has learned.

Law enforcement sources tell TMZ … Lil Baby was arrested Thursday in Atlanta for failure to signal, eluding police and reckless driving. We’re told he’s expected to be released once he posts bond later tonight.

A…