PX speedo retaining bolt help

The small bolt at the forks has snapped and refused to come out. I tried drill so I could tap it again but it started to go offline. 


Question is can I wedge in the metal barrel and rubber bung so to keep the drive in place. Is there much force when spinning and will this just pop them out? Cheers