Sponge and brush caddy set