Hi Naveen,
As I already said, this is due to some missing authorization with users when ACE try to do a user context refresh or calculates actor again. Please put a trace on user when this automatic refresh happens.
Ideally, user should have required auth. be able to execute the AFU method of his/her ACE classes.
Hope this helps.
Regards,
Satender