Latin music has intricate rhythms with microtming and dy- namic variations. Modern deep learning based generative systems generate realistic sounding drum outputs. How- ever, most rhythm generation datasets focus have a focus on pop and rock music which leads to the generations be- ing biased towards those categories. In this work, we tend to specifically develop a system that can learn the groove in Brazilian Rhythms