I figured it out.
I was doing the remapping after I enabled the interrupt group. Hence, it was calling the default ISR until it got to the remapping.
When I moved the mapping to occur BEFORE enabling the interrupts, then the interrupts occured only in my custom ISR.