The realization of topological states of matter in ultracold atomic gases is currently the subject of intense experimental activity. Using a synthetic dimension, encoded in a non-spatial degree of freedom, can greatly simplify the simulation of gauge fields and give access to exotic topological states. We review here recent advances in the field and discuss future perspectives for interacting systems.