Roberto Ribeiro broke the deadlock in the 55th minute before Alexis Claude-Maurice sealed the win in stoppage time.
Augsburg sits in ninth place, tied on points with Eintracht Frankfurt, while Cologne remains in 12th place despite missing four injured players.