Dynamic not transitioning

When I have a crescendo into ff on the last note of a measure, and the first note of the next measure is p, that notes plays as if it's ff. Does anyone know how to fix this? I tried putting a decrescendo in between the ff and p, and it somewhat worked with a little finnicking, but there must be some other way right? It's at m. 4 in the timbales.