Had this exact problem with my husband's calendar, read tons of 'advice' etc online and nothing worked - but what DOES seem to have worked is that I got my husband to log into 365 and go into his outlook calendar settings, where I was set as 'can view and edit' or something - NOT delegate (so therefore no way to switch that setting off for me either).
