Answer
The LDMA will access these structures when one of the ping pong buffers is full. Therefore if they were initialized on the stack of a function that has returned (such as an init function), the LDMA will stop. To prevent this, declare the structures as global, or static variables.
LDMA descriptor and transfer configuration