Both Permacolor and Prim use smaller, more rounded sand than your average sanded grout...so they are both less likely to scratch. With a test board, what you see is what you’re going to get. Unless you’re light and dainty on the test board, then turn into He-Man for your finished product....what you see is what you’re going to get. Tile is amazingly durable. And to handle a little sand under the pressure of a float is not a lot.
If you make a test board, grout half of it “regular”, and half of it pressing overly hard. Then examine the finished board in bright light. That should put you at ease.