Ok I'll be less lazy and give a more detailed answer:
Here are some hypothetical numbers. Your red LEDs run at 2.0v, with 10mA current through them. That means there is probably a 300ohm resistor somewhere in the matrix. If you swap in a blue LED that's rated at 3.5v and also runs at 10mA, then you'll need a resistance of 150ohms. The problem is there is already a 300ohm resistor in there, so your blue LED will probably run dim.
Now if it's the other way around where you want to swap a blue LED for a red LED, then there is probably a 150ohms resistor in there, in which case you can just add another 150ohms resistor to the red LED so it limits the current. If you don't add the resistor, then it might run out of spec and have a reduced life, or if it's too out of spec then the LED will fry. LEDs will last a very long time when running within specs. Soldering a resistor is not hard, but there is just no room on the PCB to manually add the resistor.
I hope my math is correct.