This situation is very common. Nowadays they bolt the handrails, but back in the old days they just set them in the concrete.

The problem is that over the years, water gets in there, rusts the stem and causes the corner of the step to fall apart. The 

fix for this, assuming the stem is still somewhat intact is to grind it up and drill in a few stubs of steel to hold it better.