I've tried those. I'm drilling at a slow speed, I've also tried using cutting lubricant, but that doesn't improve it.
I watched a video of somebody using a centre drill bit and it managed to work, but I don't know if they're made with a different material.