Yep, oil attracts dust and dirt. My go-to is Simple Green in a spray bottle, and a bucket of water to rinse out the sponge often. Then a 50/50 mix of white vinegar and water in a spray bottle, and wiped down with microfiber rags. Once the rag comes up pretty clean, you're done. For now. Unless you use oil again.
J. R. Good