NEW Feature: Auto-converting images and PDFs to the MuseScore format directly in MuseScore
Are you ready to see some magic :-) ?
Try new feature now! Download the build and open any score in PDF format:
And PDF score can be opened as a usual .mscz file. Magic, yeah? =)
Should you have any feedback (both suggestions and applauses) please let us know in the comments.
Сolor designation:
- Black color - recognized and editable elements on score
- Blue color - recognized elements on image (image layout is different from Musescore smart layout, so coordinates may not match)
- Purple color - unrecognised elements on image
P.S. Technically, it works like a deep cloud integration with Audiveris. You can check source code in this branch.
*If any Mac user meets some problems (e.g. Your Mac ask you to move MuseScore 3.app to trash) when you are launching this unstable version of MuseScore, consider to take the methods below:
1. Open Finder, go to "Applications" folder, find "MuseScore 3.app".
2. Open Terminal.app, copy sudo xattr -cr /Applications/MuseScore\ 3.app and paste into your terminal.
Commenti
If you'd PR it using a '+ collect_artifacts' added to the last commit message (like reopen and update https://github.com/musescore/MuseScore/pull/5692), we'd all be able to get the latest version, for Windows (from AppVeyor), as well as for Mac and Linux AppImage (from GitHub).
Edit: thanks for reopening that PR ;-)
In risposta a If you'd PR it using a '+… by Jojo-Schmitz
Latest build for Windows: https://ci.appveyor.com/project/MuseScore/musescore/builds/30772501/art…
Seems the collect_artifact stuff for Mac and Linux is broken currently, but @ABL seems to be working on it
In risposta a Latest build for Windows:… by Jojo-Schmitz
Thanks!
What is that counter in the dialog while working on the recognition, is is percentage (and if so, could that get changed to a progress bar instead)?
Edit: OK, it isn't percentage... but what else, Measure?
Edit 2: just got it to crash on a larger and scanned PDF, one that BTW did get processed by the converter on MuseScore.com
Edit 3: on an earlier import, of a score exported to PDF by MuseScore, the recognition went pretty well. No lyrics, nor any other text though, but that's the same as the PDF Import on musescore.com
In risposta a What is that counter in the… by Jojo-Schmitz
It's seconds from finish uploading and start recognition. We don't know when recognition finished (it's depends of file size and quality). To show that the process isn't hanging and you have to wait yet.
The most important thing is that you can compare what happened to be recognized with the source file and correct the flaws right there. This should be user friendly enough.
In risposta a It's seconds from finish… by Ximich
Maybe you could make that more clear in the dialog, like appending "seconds". Or just make it a spinning wheel or some such. But this is really a minor detail currently.
Yes, indeed alone that comparison is very worth it, esp. vs. the service on musescore.com.
Possible enhancement might be some way to tweak Audivers' options?
In risposta a Maybe you could make that… by Jojo-Schmitz
Recently I start working with @Tantacrul to make recognition process more clearly and user-friendly. Hope we can do it better. Right now It's just first prototype. After receiving feedback, we can improve process according to user reviews.
Yes, I continue to experiment with settings and options. This is not first week. But only now there are results that are not ashamed to show :-)
P.S. Update Audiveris on musescore.com happened after my experiments.
The 'Cancel' button is disabled while the conversion runs, so no way to interrupt?
I've been waiting for this feature since I can remember, but I've couldn't test it because it gives me "file damaged" message. Any help?
macOS Catalina
In risposta a I've been waiting for this… by OsmelCruz
@OsmelCruz :
You can try to strip the "quarantine" attribute to the application (with which Mac automatically flags this file downloaded from Internet):
from terminal, navigate to the folder where the application resides (e.g.
cd /Applications) and then use:xattr -d com.apple.quarantine 'MuseScore 3 2.app'(where 'MuseScore 3 2.app' is the name of the application)
In risposta a @OsmelCruz : You can try to… by ABL
Thank you ABL, I already have enabled install from everywhere (sudo spctl --master-disable) I have MuseScore 3.4.2 installed and running. BTW, xattr didn't work. Is there any other build I can try?
In risposta a Thank you @ABL, I already… by OsmelCruz
Try this build please: https://drive.google.com/file/d/1hTm_asE_rC1biXrEC2COlPdT_bgXZ-iN/view?…
This is very exciting. I look forward to seeing this in action (and helping to deal with the inevitable bugs that may come with it ;)).
Looks awesome, is this available in the App Image yet?
A most definitely welcomed functionality.
This looks very exciting! Thanks to everyone for their efforts.
If I'm not mistaken, Audiveris may not yet be able to handle non-standard notation such as drumsets or tablature yet (often found in band scores); this would be very useful when realised, hence my hope that more resources can be invested into that project somehow, as I think it would be of tremendous benefit to both. I think one of the most important aspects is improving MusicXML import/export.
To any of the developers (here or there): if there's interest what I've mentioned, please contact me and I will provide samples (both PDF and mscz).
I'm so happy this feature is finally implemented. Will the accuracy of scanned PDF files be improved? I tried importing something from IMSLP and everything was wrong...
Marvellous! Will try it out ASAP.
In risposta a Marvellous! Will try it out… by Howard-C
Woo, just realized that "Audiveris import" PR means this!! You have my total support :D
> P.S. Technically, it works like a deep cloud integration with Audiveris.
This is great. However, I'm leery of having my work uploaded to an unknown location, and I'm sure others will feel the same way. Is there any way to implement this as a purely local feature?
In risposta a > P.S. Technically, it works… by Spire42
If you use MuseScore to create your work, why use this functionality?
In risposta a If you use MuseScore to… by Howard-C
Maybe I'm converting my own old printed sheet music into editable digital sheet music.
Maybe I'm converting a PDF of sheet music that I paid for but that doesn't allow redistribution.
In risposta a Maybe I'm converting old… by Spire42
Don't worry, your PDF files doesn't go to public access. They are treated as anonymized data.
In risposta a Don't worry, your PDF files… by Ximich
That may be so, but redistribution is redistribution.
In risposta a That may be so, but… by Spire42
Handing it out to a service provider temporarily, who does something with it for you in your name, and then deletes all copies of it, isn’t.
In risposta a Handing it out to a service… by mirabilos
How do you know they delete all copies?
In risposta a How do you know they delete… by reddiesel41264
It is called trust ;-)
Also it'd be their copyright violations, not yours
Take your score file to a copy shop, hand it to the shop owner, askimg him to make 50 copies and bind them, you'd gonna pick them up the next day.
If he makes 51, to keep one and publish that, he's a criminal.
In risposta a It is called trust ;-) by Jojo-Schmitz
Indeed (unless they tell you they won’t), as long as they’re just offering a conversation service for you.
In risposta a It is called trust ;-) by Jojo-Schmitz
I'm very un-trusting, I'd rather do my own computing, I'm sure my system could handle the extra workload.
In risposta a How do you know they delete… by reddiesel41264
How do you know they delete all copies?
I don't. I do know though that the old Pdf import did not delete them.
In risposta a Handing it out to a service… by mirabilos
I'm not a lawyer, but I suspect that a court of law would disagree with you.
In risposta a I'm not a lawyer, but I… by Spire42
Hi,
A remark that makes me think that PDFs are not automatically destroyed after conversion :
If you reload the same PDf a second time the conversion is almost immediate, the counter doesn't even have time to start up.
Having said that, I am not worried about that and I would prefer to discuss here the desired performance and improvements: There is really a lot to be done but almost no suggestions, remarks, proposals in this sense.
In risposta a Hi, A remark that makes me… by Papibois
Same thing happens with the current PDF Import on the website. It even seems to take the conversion of someone else, if it is the same PDF (guess it uses some kind of fingerprint algorithm to detect that)
In risposta a Same thing happens with the… by Jojo-Schmitz
Using SaaSS is no different to using a proprietary program.
In risposta a Using SASS is no different… by reddiesel41264
SaaS ITYM?
Perhaps, yes. I tried installing Audiveris locally and using it directly once, with even worse results than what the website offered.
In risposta a SaaS ITYM? Perhaps, yes. I… by mirabilos
Service as a Software Substitute - SaaSS https://www.gnu.org/philosophy/words-to-avoid.html#SaaS
In risposta a Service as a Software… by reddiesel41264
Ah, I didn’t know that Stallmannism yet. I stand corrected.
In risposta a SaaS ITYM? Perhaps, yes. I… by mirabilos
Using Audiveris with all default options and not interacting with the UI at all to make improvements to the conversion is indeed not going to do any better. But it's actually quite sophisticated in what you can do with it if you spend some time tweaking things after the initial attempt at conversion.
In risposta a > P.S. Technically, it works… by Spire42
If we enable local recognition, this is:
- increase size of final distribution by 30%
- will require Java 1.8 installation
We haven't yet decided how recognition should work best. Perhaps for final release we will find a better solution. So far, this is first alpha version that gives you the opportunity to try this feature.
In risposta a If we enable local… by Ximich
Thanks. I'm glad to hear that it's at least theoretically possible.
Maybe it can be managed as an optional extension, similar to the MuseScore General HQ SoundFont and MuseScore Drumline.
In risposta a Thanks. I'm glad to hear… by Spire42
I support this idea.
In risposta a Thanks. I'm glad to hear… by Spire42
+1
In risposta a Thanks. I'm glad to hear… by Spire42
Yes, modularize it.
xattr -cr /Applications/MuseScore\ 3.appand paste into your terminal.In risposta a If any Mac user meets some… by David Copperfield
Thank you so much! This worked really well. I needed to add sudo before your code to grant administrator rights to the command line. Really grateful.
In risposta a If any Mac user meets some… by David Copperfield
This is what happens when launching the MuseScoreNightly just after I have installed it & double-clicking on the blue icon in the bin folder. I am using the latest musescore 3.4.2 on a Windows 64 bit sys. Please can anyone provide help on how to scale through this?
In risposta a This is what happens when… by ndy
Hello ndy
On Windows 10 64bits also I had no problem to install this nightly which cohabits very well with my version 3.4.2.
Did you extract all the compressed files in a new folder and click on the Nightly.exe of this new folder ?
In risposta a Hello ndy On Windows 10… by Papibois
Yes I did but the problem still persist.
Bravo Ximich: That's a great improvement!
I've been testing it for two days on Windows 10.
Here are my remarks:
- I really appreciate using the "Open" menu to start PDF recognition.
- I also appreciate the counter that appears to show that the process is in progress. Moreover it is relatively fast: For an IMSLP PDF of 5 pages of medium quality, the counter is up to 550 which represents 4mn.
-Good surprise also, the music regognition integrates the staves to come by introducing empty staves from the beginning. This is one of the major difficulties of all Music OCR programs (I am a big user of PhotoScore Ultimate 8).
- The vast majority of the notes are in place and the result is better on this point than by going through the "Import PDF" menu.
- With the purple elements, one can understand from the start what Audiveris has not been able to transcribe and therefore what remains to be corrected manually.
On the other hand, I don't really understand what the elements in blue bring, which are like an offset shadow and never in place of good notes.
I made some tests from an IMSLP version of the introductory chorus of Hoffmann's Tales which is in 3/8. Unfortunately if the time signature is not recognized (which it was), the 4/4 is apparently set by default which makes museScore say it's a corrupted file. I ignore it and open it anyway, but I can't put the time signature in 3/8. The program systematically bugs. Although I can act normally on everything else.
Here are my first findings. Congratulations again for your research in this field
CteHoff p56789.mscz
CteHoff p56789.pdf
In risposta a Bravo Ximich: That's a great… by Papibois
I don't understand what does the increasing number mean. It can often reach a value more than 100, which I cannot find meanings by myself. Mind explaining a bit?
In risposta a I don't understand what does… by Howard-C
It is seconds elapsed (since start of conversion), as explained above
In risposta a It is seconds elapsed (since… by Jojo-Schmitz
Really? Because sometimes I see the climbing going slow and other times faster.
In risposta a Really? Because sometimes I… by Howard-C
Hi,
It seems to me that the numbers are scrolling much faster than the seconds since in my example above the process took 4 minutes i.e. 240 seconds and the counter was showing 550.
But that doesn't seem very important to me since in my opinion, it only serves to show that the process is moving forward.
In risposta a Hi, It seems to me that the… by Papibois
I think it isn't very unimportant either, because a mysterious climbing value which no one can understand is awkward to be there.
In risposta a I think it isn't very… by Howard-C
Just like an hourglass. Nothing more :)
Have you tried this new feature? What do you think about it?
In risposta a Just like an hourglass… by Papibois
I tried it, and forgive me if I'm too straightforward, but I think the feature in its present situation is far from persuasive to not let transcribers of middle-sized to large scores transcribe note-by-note by themselves.
In risposta a I tried it, and forgive me… by Howard-C
I agree with you but I am more optimistic and I think that sooner or later this way of doing things will prevail. And, as a result, I think that the music publishing programs that have not integrated it will be ignored.
That's why I'm glad that MuseScore is taking a closer look at it.
In risposta a I agree with you but I am… by Papibois
I'm glad too. Being a person who's very interested in computer vision, I'm looking forward to seeing the functionality become better and better.
Would love to try this, but I'm paralyzed due to the latest install not working. "“MuseScore 3” can’t be opened because Apple cannot check it for malicious software." Please fix ASAP.
In risposta a Would love to try this, but… by Hmacdonald
Please check my comment above
Amazing!
Worked fine a couple of times, but then I tried a longer .pdf and crashed. It didn't work anymore. Any idea how to solve this?
In risposta a Worked fine a couple of… by Miguel Vicente…
Hi,
Yes, I had that yesterday, too, but it's operational again. That said, there are still a lot of improvements to be made.
Here is a test on an excerpt from "La traviata" including 52 measurements with 12 staves per system. The original PDF is from the ISMLP site and is of medium quality. MuseScore converts it in 2 minutes but is repeatedly mistaken about the time signature:
In this example, 3/4 is recognized at the beginning but afterwards, about 80% of the measurements are read in 7/8. It is necessary to put them back in 3/4 one by one.
Here is the starting PDF and what MuseScore offers (without corrections on my part)
TRA 33-38.pdf
TRA 33-38Audiv.mscz
I didn't get any sound on the You Tube tutorial. Will I be able to do this on my Android?
In risposta a I didn't get any sound on… by jonb53460
I don't think the video had sound. Anyhow, the feature mentioned is being proposed for the MuseScore notation editor, not the mobile reader/player apps as far as I know,.
Hi,
It seems to me that the following nighlys have not taken up this possibility in the menu file>Open
In risposta a Hi, It seems to me that the… by Papibois
It's never been in any 'official' nightly, just in some special trial versions. The code is in meanwhile though, but currently disabled
In risposta a It's never been in any… by Jojo-Schmitz
Indeed! I made a mistake
How soon can we try it in Linux, please?
Great new feature!
Is this continuing to be developed?
In risposta a Is this continuing to be… by mike320
Apparently not. IIRC the code has even been removed from the master branch
In risposta a Apparently not. IIRC the… by Jojo-Schmitz
Why
In risposta a Why by Howard-C
Likely because it was a developer experiment that required extensive maintenance which can't be provided.
Can I use this with MuseScore 3.6?
In risposta a Can I use this with… by musicbyandy
No, as mentioned in the replies above, it was a sidelined developer experiment that amounted to nothing.