My experience is that 3D-printed Nylon keycaps are almost indestructible. Frosted plastic can be fragile if dropped, but will be completely durable under normal keyboard use unless the design itself is particularly delicate - like say there are tiny, tiny antennae on an insect's head which can be snapped off, that sort of thing.
Generally both materials will hold up as well as ABS or PBT I would think.