Based on some very strong recent feedback from a major keyboard reviewer, who is also a forum member here preparing a new Model F review, I have posted a draft video and am looking for feedback:
"Dead simple Model F Keyboard Layout Customization in 16 minutes: QMK and Via"
After viewing from start to finish, is this sufficient as an introductory video, with the encouragement to review the detailed QMK and Via manuals for further exploration?
I am greatly looking forward to the upcoming review video as I think it will be another great Model F keyboard review, maybe one of the best and most thorough! The amount of research and effort that goes into this reviewer's work is very comprehensive and it shows that a lot of research and care was put into each video. Kind of reminds me of the old very well done, deeply thorough tech reviews I would read when deciding on computer parts to build my next system. Even articles specifically discussing hardware LUT calibration on my computer monitor screens and how to optimize color accuracy, for example.
As a note the comments in the below video are not directed at any one person, and please do not bother or contact the reviewer as reviewers should be unbiased and independent without pressure to change anything they say.
I have been emailing back and forth a lot with the the reviewer in question, who replied to me that they figured things out as of now but that the firmware customization process was extremely difficult and that this would be reflected strongly in the commentary. I agree that no one should have as much of a negative experience with the Model F as this reviewer - it should never happen and if it does it should be at least mentioned.
However, I was completely surprised by this note. I haven't heard of complaints that people spent over an hour in frustration just trying to figure out how to update the layout in recent months, with the latest documentation. I think both QMK and Via are great and easy to work with in my opinion and am very grateful to pandrew and darkcruix for improving the xwhatsit Model F experience.
I am worried. My main concern is that people interested in the Model F will view the video and develop a false opinion on the difficulty of the firmware, which will make them not consider any Model F keyboard, original or new. Also not an insignificant note, based on my email conversations I'd say less than 10-15% of Model F users make even one layout change in the firmware (I believe many use Autohotkey or similar key remapping software instead for simple mappings, or the built in Apple remapping settings for command/option/etc.).
This new video I believe shows that the Model F firmware can be set up in minutes for most users and that it's easy to do and does not require opening up the keyboard.
I understand fully that a review ought to be based on the reviewer's subjective personal experience with the product as possibly one of the most important factors, but with something like a Model F keyboard which has been around for decades without the ability to reprogram layouts and the focus of this project being a hardware reproduction of Model F keyboards, I feel that the focus of any Model F review can include comments on personal experiences but ought to concentrate on how a typical user's experience would be going forward with the Model F hardware, not as much on the add-on firmware features that appeal to more of a power user customizing firmware (I'd consider any Model F firmware customizer as a power user). In my experience most people I've messaged with like the Model F for the typing experience, with the outstanding amount of programmability as a plus for some.
Admittedly as noted before, the documentation should have been fleshed out much earlier. I think the primary part of a keyboard review should be about the keyboard experience that 85-90% of Model F users have, which is just using the keyboard without firmware-level key remapping, though I understand that every feature should be easily accessible in any product.
Why scare people away from the Model F by skewering an experience that nearly no one has had or will ever encounter with respect to reprogramming firmware? I guess the question is if (a big if) the new video and the manuals are sufficient for 99.9% of those "power users" new to QMK and Via on the Model F, should the emphasis of any Model F review be on a typical user's experience who is yet to try out the xwhatsit controller on a Model F and will come across this new video in the manual before starting if they want to make some layout changes?
Please let me be clear: my intention is not to denigrate, intimidate or call for change with anyone in particular but to discuss what is the essential usefulness of a Model F to most people and how much of a review should focus exclusively on what's most important to most people. I would be saddened if thousands of people are turned away from the IBM and new Model F keyboards because of insufficient firmware documentation. I am hopeful that this new video might have changed the reviewer's experience had it been made earlier, and will help out everyone going forward.
Please do keep the comments respectful and considerate, and not directed at any one person or mentioning any names. My intention is only for a generalized discussion on keyboard reviews.