Hi
I think you did not configure the time out in receiver file adapter and the file channel is hanging if there is a connectivity problems.
Check this sap note 849089 - File Adapter: FTP Timeout Handling
Configure the time out in all file channels then then the messages will be not going to TO BE DELIVERED status.
Check point 1 in the above mention blog:
Regards,
Praveen.