The correct cutting blade/bit is the most important factor in any cut, in any material. Type of material the blade/bit is made of, the number of teeth, size of teeth, angle of teeth, space between teeth, etc. If it's a drill then there are a few less criteria, but the principle is the same. Then follows speed. Speed is somewhat related to the power needed to push through the material, but is definitely a factor for heat that degrades the cutting blade and then can overheat the material being cut, which can have adverse affects.
There is an entire science to cutting. If you know just a tiny fraction of it, your life will be a lot easier, and your work will be much better.
I usually just file plastics now for small stuff.