[RNIB] very important features suggestion

• Sep 10, 2018 - 17:02

Hello, dear developers of the MuseScore software!
I'm a totally blind composer and pianist. I would like to suggest some features that my friends (also visually impaired composers and musicians) and me need very much.
Please, make accessibility features equally available for all OS versions (windows, linux and mac os), because today we, blind musicians, can use only very old version of Sibelius (5.25) on windows with jaws screenreader only. As far as I know, there are no fully accessible music notation software for linux or mac os, so if you make your software fully accessible for all platforms, it really will be software №1!
Below are our suggestions:
1. Make a control, which allows to set key signature during the creation score wizard readable for screenreaders. You can use the sibelius 5.x style two comboboxes for selection sharps and flats and radiobutton for switching between major and minor, finale style slider, where going upwards increases sharps and downwards increases flats and radiobutton to choose major or minor, or any other solution - we just need to be able to control which key signature is selected now. Now this control is totally inaccessible, screenreaders tell us nothing.
2. Make it possible to switch between staves inside the score while editing using key commands, e.g. ctrl+alt+arrows up/down. Also we need information about what instrument is on this or that stave. For example, when we move to the stave 2, we need to hear information about what instrument we will edit while editing notes on this stave. Something like that - "stave 2, flute". Now software tells us only the stave number, not the instrument name. Also we need the focus to remain on the same measure - for example, we edited the second measure on stave 1, then switched to stave 2 and we should get in the second measure on that stave, not in the beginning of score.
3. Make the errors highlighting accessible - for example, if the note is out of instrument range, it is highlighted (red, I think), and we would like to hear something like "out of range" when the highlighted note is focused.
4. Maybe, the tabstopped toolbars is not very convinient thing, it would be much better if score will never lose focuse.
5. As for fast input it would be a very good idea to take the sibelius multipage numpad set - by pressing "+" on numpad user switches between some input types (common notes, more notes, accidentals, articulation, jazz articulation, tremolos and so on), by pressing numbers, ".", "/", "*", "-" and enter on numpad user chooses the input type - for example, in common notes mode 6 is whole note, 5 - halve note and so on, then by pressing letters he enters the note on the stave. If you choose this type, you can get sibelius shortcuts - they are convinient and all visually impaired users and many regular users know them well. In this case it would be very useful to tell us what kind of input is selected - when we press "6" in common notes mode we would like to hear "whole notes selected".
6. As for selected note speaking while navigating through the score, it would be a nice way to tell us something like that: "measure X (at the beginning of each measure), a4 ("a" - the name of the note, "4" - octave), quorter (for example). The octaves can be named from 0 (the lowest) and to 7 or even 8 - standard midi octave naming. It would be a good and useful to hear the page numbers, system numbers and all objects (not only notes) during score navigation too.
7. Also very important is to control what is going on with other objects, like tempo markings, key signatures, time signatures, clefs, slurs, articulations, dynamic markings and so on. When we switch to a new stave, we also should know, which clef, tempo and so on is actual for this measure on this stave, when we select a note if it has some markings or lyrics on it, we should hear them. And, certenly, we should be able to edit all these things.
8. Other information, which can be very useful for us. When we switch to the stave, it would be good to tell us not only the stave number and instrument name, but also, maybe, the instrument range - something like that: stave 2, flute, range from c4 to c7. Also when we switch to the new stave, it will be good to remind what measure are we in now - stave 1, flute, range is from c4 to c7, measure 5.
These are not all features, but only main features that require visually impaired composers and musicians. We understand, that it is a hard job to make notation fully accessible, but we need it really very-very much. In short words - we need all aspects of score, which can be seen by regular user, somehow reported to us using screenreader output. Sometimes we participate in competitions, sometimes make scores for orchestras or ensembles and always we need to produce high quolity score - we really can do it, but we need to know everything about notes and other objects, which we enter in score.
Thank you!
Best regards, Alexander.


Comments

You have made many good points that will make using the software easier for a blind person to use. I don't program, so I can't do anything to help except to say, keep this discussion alive because there are those who want to improve the ability for blind people to be able to use MuseScore. I do have two observations that may help.

First, MuseScore is a cross-platform program with the same capabilities in each of 3 main Operating Systems to the extent possible. Most of the few differences have to do with Mac not having some buttons on the keyboard and only one mouse button. All of these can be overcome if you are sighted or not either using standard alternate methods or defining different shortcuts in the preferences.

Second, navigation between staves already stays in the same measure if you use Alt + up and down arrow keys. One thing a blind person may not realize is that within a staff, alt+up moves from voice 4 to voice 1 while alt+down move from voice 1 to 4. From voice 1, alt+up moves to voice 1 of the staff above it. When you are on voice 4 (or the lowest existing voice on the staff) alt+down moves to voice 1 of the staff below. As I said, all of these stay in the same measure when they change staves.

This topic is indeed very relevant and I think it got little attention because of the vague title. The title could be something like "accessibility features for blind MuseScore users". Sorry, I don't know what RNIB means.

Well, as a programmer with some experience, I would suggest these global approaches:
· Every function or command accessible from the user should be easily accessible through some shortcut (hotkey) and or an easily accessible keyboard path. Entering everything should be possible from the keyboard and the most used commands should have the shortest hotkeys.
· Every output or command should produce a corresponding audio output. For simple commonly used commands, a beep would be the best choice, but never the same beep for different functions/commands. Also a call to a function could send some text string to the terminal and some other text-to-voice programme could synthesize it to speech.

In reply to by Ludwig van Benteuer

Yes, that's good idea. Maybe, beeps are not very good, but the text sent to terminal and to the screenreader (nvda for windows, voice over for mac and orca for linux) is prefered. If you are interested in, I can attach a jaws scripts for sibelius, that's the only accessibility solution for scoreing I have.

Indeed, it is a hard job, but it is one we take seriously. As mentioned, there has been a considerable amount of work done, but much of it has not yet been merged into the main code yet for various reasons. I am still hopeful that this will happen over time. Still some things to work out in terms of support from the Qt library that we use to help manage the user interface.

Some of what you describe is possible already, even in 2.3.2. For example, as mentioned Alt+Down already is available to move the input cursor up or down through staves (and chors or voices on each staff). You can also use Edit / Preferences / Shortcuts to define a shortcut that moves by staff or voice only (skipping other notes in the chord). Also, navigation does read the current location etc, if using the NVDA screenreader. And you can navigate to key signatures and some other markings using Ctrl+Alt+Shift+Left/Right.

For more on the accessibility features as they exist already, see https://musescore.org/en/handbook/accessibility

Do you still have an unanswered question? Please log in first to post your question.