It is still a point of litigation, however based on various case laws we can draw a conclusion that such late fees is not a expenditure incurred by an assessee for any purpose which is an offence or which is prohibited by law.
Hence it will be allowed as expense.
Same goes for interest.
Yes it will be allowed you can refer the case of Rajasthan State beverages case law 250 taxman 0016.
Hope you find the information helpful if you do please rate it 5 and provide your valuable feedback for my improvement.
Thank you.