NEW Feature: Auto-converting images and PDFs to the MuseScore format directly in MuseScore
Are you ready to see some magic :-) ?
Try new feature now! Download the build and open any score in PDF format:
And PDF score can be opened as a usual .mscz file. Magic, yeah? =)
Should you have any feedback (both suggestions and applauses) please let us know in the comments.
Сolor designation:
- Black color - recognized and editable elements on score
- Blue color - recognized elements on image (image layout is different from Musescore smart layout, so coordinates may not match)
- Purple color - unrecognised elements on image
P.S. Technically, it works like a deep cloud integration with Audiveris. You can check source code in this branch.
*If any Mac user meets some problems (e.g. Your Mac ask you to move MuseScore 3.app to trash) when you are launching this unstable version of MuseScore, consider to take the methods below:
1. Open Finder, go to "Applications" folder, find "MuseScore 3.app".
2. Open Terminal.app, copy sudo xattr -cr /Applications/MuseScore\ 3.app and paste into your terminal.
Comments
If you'd PR it using a '+ collect_artifacts' added to the last commit message (like reopen and update https://github.com/musescore/MuseScore/pull/5692), we'd all be able to get the latest version, for Windows (from AppVeyor), as well as for Mac and Linux AppImage (from GitHub).
Edit: thanks for reopening that PR ;-)
In reply to If you'd PR it using a '+… by Jojo-Schmitz
Latest build for Windows: https://ci.appveyor.com/project/MuseScore/musescore/builds/30772501/art…
Seems the collect_artifact stuff for Mac and Linux is broken currently, but @ABL seems to be working on it
In reply to Latest build for Windows:… by Jojo-Schmitz
Thanks!
What is that counter in the dialog while working on the recognition, is is percentage (and if so, could that get changed to a progress bar instead)?
Edit: OK, it isn't percentage... but what else, Measure?
Edit 2: just got it to crash on a larger and scanned PDF, one that BTW did get processed by the converter on MuseScore.com
Edit 3: on an earlier import, of a score exported to PDF by MuseScore, the recognition went pretty well. No lyrics, nor any other text though, but that's the same as the PDF Import on musescore.com
In reply to What is that counter in the… by Jojo-Schmitz
It's seconds from finish uploading and start recognition. We don't know when recognition finished (it's depends of file size and quality). To show that the process isn't hanging and you have to wait yet.
The most important thing is that you can compare what happened to be recognized with the source file and correct the flaws right there. This should be user friendly enough.
In reply to It's seconds from finish… by Ximich
Maybe you could make that more clear in the dialog, like appending "seconds". Or just make it a spinning wheel or some such. But this is really a minor detail currently.
Yes, indeed alone that comparison is very worth it, esp. vs. the service on musescore.com.
Possible enhancement might be some way to tweak Audivers' options?
In reply to Maybe you could make that… by Jojo-Schmitz
Recently I start working with @Tantacrul to make recognition process more clearly and user-friendly. Hope we can do it better. Right now It's just first prototype. After receiving feedback, we can improve process according to user reviews.
Yes, I continue to experiment with settings and options. This is not first week. But only now there are results that are not ashamed to show :-)
P.S. Update Audiveris on musescore.com happened after my experiments.
The 'Cancel' button is disabled while the conversion runs, so no way to interrupt?
I've been waiting for this feature since I can remember, but I've couldn't test it because it gives me "file damaged" message. Any help?
macOS Catalina
In reply to I've been waiting for this… by OsmelCruz
@OsmelCruz :
You can try to strip the "quarantine" attribute to the application (with which Mac automatically flags this file downloaded from Internet):
from terminal, navigate to the folder where the application resides (e.g.
cd /Applications) and then use:xattr -d com.apple.quarantine 'MuseScore 3 2.app'(where 'MuseScore 3 2.app' is the name of the application)
In reply to @OsmelCruz : You can try to… by ABL
Thank you ABL, I already have enabled install from everywhere (sudo spctl --master-disable) I have MuseScore 3.4.2 installed and running. BTW, xattr didn't work. Is there any other build I can try?
In reply to Thank you @ABL, I already… by OsmelCruz
Try this build please: https://drive.google.com/file/d/1hTm_asE_rC1biXrEC2COlPdT_bgXZ-iN/view?…
This is very exciting. I look forward to seeing this in action (and helping to deal with the inevitable bugs that may come with it ;)).
Looks awesome, is this available in the App Image yet?
A most definitely welcomed functionality.
This looks very exciting! Thanks to everyone for their efforts.
If I'm not mistaken, Audiveris may not yet be able to handle non-standard notation such as drumsets or tablature yet (often found in band scores); this would be very useful when realised, hence my hope that more resources can be invested into that project somehow, as I think it would be of tremendous benefit to both. I think one of the most important aspects is improving MusicXML import/export.
To any of the developers (here or there): if there's interest what I've mentioned, please contact me and I will provide samples (both PDF and mscz).
I'm so happy this feature is finally implemented. Will the accuracy of scanned PDF files be improved? I tried importing something from IMSLP and everything was wrong...
Marvellous! Will try it out ASAP.
In reply to Marvellous! Will try it out… by Howard-C
Woo, just realized that "Audiveris import" PR means this!! You have my total support :D
> P.S. Technically, it works like a deep cloud integration with Audiveris.
This is great. However, I'm leery of having my work uploaded to an unknown location, and I'm sure others will feel the same way. Is there any way to implement this as a purely local feature?
In reply to > P.S. Technically, it works… by Spire42
If you use MuseScore to create your work, why use this functionality?
In reply to If you use MuseScore to… by Howard-C
Maybe I'm converting my own old printed sheet music into editable digital sheet music.
Maybe I'm converting a PDF of sheet music that I paid for but that doesn't allow redistribution.
In reply to Maybe I'm converting old… by Spire42
Don't worry, your PDF files doesn't go to public access. They are treated as anonymized data.
In reply to Don't worry, your PDF files… by Ximich
That may be so, but redistribution is redistribution.
In reply to That may be so, but… by Spire42
Handing it out to a service provider temporarily, who does something with it for you in your name, and then deletes all copies of it, isn’t.
In reply to Handing it out to a service… by mirabilos
How do you know they delete all copies?
In reply to How do you know they delete… by reddiesel41264
It is called trust ;-)
Also it'd be their copyright violations, not yours
Take your score file to a copy shop, hand it to the shop owner, askimg him to make 50 copies and bind them, you'd gonna pick them up the next day.
If he makes 51, to keep one and publish that, he's a criminal.
In reply to It is called trust ;-) by Jojo-Schmitz
Indeed (unless they tell you they won’t), as long as they’re just offering a conversation service for you.
In reply to It is called trust ;-) by Jojo-Schmitz
I'm very un-trusting, I'd rather do my own computing, I'm sure my system could handle the extra workload.
In reply to How do you know they delete… by reddiesel41264
How do you know they delete all copies?
I don't. I do know though that the old Pdf import did not delete them.
In reply to Handing it out to a service… by mirabilos
I'm not a lawyer, but I suspect that a court of law would disagree with you.
In reply to I'm not a lawyer, but I… by Spire42
Hi,
A remark that makes me think that PDFs are not automatically destroyed after conversion :
If you reload the same PDf a second time the conversion is almost immediate, the counter doesn't even have time to start up.
Having said that, I am not worried about that and I would prefer to discuss here the desired performance and improvements: There is really a lot to be done but almost no suggestions, remarks, proposals in this sense.
In reply to Hi, A remark that makes me… by Papibois
Same thing happens with the current PDF Import on the website. It even seems to take the conversion of someone else, if it is the same PDF (guess it uses some kind of fingerprint algorithm to detect that)
In reply to Same thing happens with the… by Jojo-Schmitz
Using SaaSS is no different to using a proprietary program.
In reply to Using SASS is no different… by reddiesel41264
SaaS ITYM?
Perhaps, yes. I tried installing Audiveris locally and using it directly once, with even worse results than what the website offered.
In reply to SaaS ITYM? Perhaps, yes. I… by mirabilos
Service as a Software Substitute - SaaSS https://www.gnu.org/philosophy/words-to-avoid.html#SaaS
In reply to Service as a Software… by reddiesel41264
Ah, I didn’t know that Stallmannism yet. I stand corrected.
In reply to SaaS ITYM? Perhaps, yes. I… by mirabilos
Using Audiveris with all default options and not interacting with the UI at all to make improvements to the conversion is indeed not going to do any better. But it's actually quite sophisticated in what you can do with it if you spend some time tweaking things after the initial attempt at conversion.
In reply to > P.S. Technically, it works… by Spire42
If we enable local recognition, this is:
- increase size of final distribution by 30%
- will require Java 1.8 installation
We haven't yet decided how recognition should work best. Perhaps for final release we will find a better solution. So far, this is first alpha version that gives you the opportunity to try this feature.
In reply to If we enable local… by Ximich
Thanks. I'm glad to hear that it's at least theoretically possible.
Maybe it can be managed as an optional extension, similar to the MuseScore General HQ SoundFont and MuseScore Drumline.
In reply to Thanks. I'm glad to hear… by Spire42
I support this idea.
In reply to Thanks. I'm glad to hear… by Spire42
+1
In reply to Thanks. I'm glad to hear… by Spire42
Yes, modularize it.
xattr -cr /Applications/MuseScore\ 3.appand paste into your terminal.In reply to If any Mac user meets some… by David Copperfield
Thank you so much! This worked really well. I needed to add sudo before your code to grant administrator rights to the command line. Really grateful.
In reply to If any Mac user meets some… by David Copperfield
This is what happens when launching the MuseScoreNightly just after I have installed it & double-clicking on the blue icon in the bin folder. I am using the latest musescore 3.4.2 on a Windows 64 bit sys. Please can anyone provide help on how to scale through this?
In reply to This is what happens when… by ndy
Hello ndy
On Windows 10 64bits also I had no problem to install this nightly which cohabits very well with my version 3.4.2.
Did you extract all the compressed files in a new folder and click on the Nightly.exe of this new folder ?
In reply to Hello ndy On Windows 10… by Papibois
Yes I did but the problem still persist.
Bravo Ximich: That's a great improvement!
I've been testing it for two days on Windows 10.
Here are my remarks:
- I really appreciate using the "Open" menu to start PDF recognition.
- I also appreciate the counter that appears to show that the process is in progress. Moreover it is relatively fast: For an IMSLP PDF of 5 pages of medium quality, the counter is up to 550 which represents 4mn.
-Good surprise also, the music regognition integrates the staves to come by introducing empty staves from the beginning. This is one of the major difficulties of all Music OCR programs (I am a big user of PhotoScore Ultimate 8).
- The vast majority of the notes are in place and the result is better on this point than by going through the "Import PDF" menu.
- With the purple elements, one can understand from the start what Audiveris has not been able to transcribe and therefore what remains to be corrected manually.
On the other hand, I don't really understand what the elements in blue bring, which are like an offset shadow and never in place of good notes.
I made some tests from an IMSLP version of the introductory chorus of Hoffmann's Tales which is in 3/8. Unfortunately if the time signature is not recognized (which it was), the 4/4 is apparently set by default which makes museScore say it's a corrupted file. I ignore it and open it anyway, but I can't put the time signature in 3/8. The program systematically bugs. Although I can act normally on everything else.
Here are my first findings. Congratulations again for your research in this field
CteHoff p56789.mscz
CteHoff p56789.pdf
In reply to Bravo Ximich: That's a great… by Papibois
I don't understand what does the increasing number mean. It can often reach a value more than 100, which I cannot find meanings by myself. Mind explaining a bit?
In reply to I don't understand what does… by Howard-C
It is seconds elapsed (since start of conversion), as explained above
In reply to It is seconds elapsed (since… by Jojo-Schmitz
Really? Because sometimes I see the climbing going slow and other times faster.
In reply to Really? Because sometimes I… by Howard-C
Hi,
It seems to me that the numbers are scrolling much faster than the seconds since in my example above the process took 4 minutes i.e. 240 seconds and the counter was showing 550.
But that doesn't seem very important to me since in my opinion, it only serves to show that the process is moving forward.
In reply to Hi, It seems to me that the… by Papibois
I think it isn't very unimportant either, because a mysterious climbing value which no one can understand is awkward to be there.
In reply to I think it isn't very… by Howard-C
Just like an hourglass. Nothing more :)
Have you tried this new feature? What do you think about it?
In reply to Just like an hourglass… by Papibois
I tried it, and forgive me if I'm too straightforward, but I think the feature in its present situation is far from persuasive to not let transcribers of middle-sized to large scores transcribe note-by-note by themselves.
In reply to I tried it, and forgive me… by Howard-C
I agree with you but I am more optimistic and I think that sooner or later this way of doing things will prevail. And, as a result, I think that the music publishing programs that have not integrated it will be ignored.
That's why I'm glad that MuseScore is taking a closer look at it.
In reply to I agree with you but I am… by Papibois
I'm glad too. Being a person who's very interested in computer vision, I'm looking forward to seeing the functionality become better and better.
Would love to try this, but I'm paralyzed due to the latest install not working. "“MuseScore 3” can’t be opened because Apple cannot check it for malicious software." Please fix ASAP.
In reply to Would love to try this, but… by Hmacdonald
Please check my comment above
Amazing!
Worked fine a couple of times, but then I tried a longer .pdf and crashed. It didn't work anymore. Any idea how to solve this?
In reply to Worked fine a couple of… by Miguel Vicente…
Hi,
Yes, I had that yesterday, too, but it's operational again. That said, there are still a lot of improvements to be made.
Here is a test on an excerpt from "La traviata" including 52 measurements with 12 staves per system. The original PDF is from the ISMLP site and is of medium quality. MuseScore converts it in 2 minutes but is repeatedly mistaken about the time signature:
In this example, 3/4 is recognized at the beginning but afterwards, about 80% of the measurements are read in 7/8. It is necessary to put them back in 3/4 one by one.
Here is the starting PDF and what MuseScore offers (without corrections on my part)
TRA 33-38.pdf
TRA 33-38Audiv.mscz
I didn't get any sound on the You Tube tutorial. Will I be able to do this on my Android?
In reply to I didn't get any sound on… by jonb53460
I don't think the video had sound. Anyhow, the feature mentioned is being proposed for the MuseScore notation editor, not the mobile reader/player apps as far as I know,.
Hi,
It seems to me that the following nighlys have not taken up this possibility in the menu file>Open
In reply to Hi, It seems to me that the… by Papibois
It's never been in any 'official' nightly, just in some special trial versions. The code is in meanwhile though, but currently disabled
In reply to It's never been in any… by Jojo-Schmitz
Indeed! I made a mistake
How soon can we try it in Linux, please?
Great new feature!
Is this continuing to be developed?
In reply to Is this continuing to be… by mike320
Apparently not. IIRC the code has even been removed from the master branch
In reply to Apparently not. IIRC the… by Jojo-Schmitz
Why
In reply to Why by Howard-C
Likely because it was a developer experiment that required extensive maintenance which can't be provided.
Can I use this with MuseScore 3.6?
In reply to Can I use this with… by musicbyandy
No, as mentioned in the replies above, it was a sidelined developer experiment that amounted to nothing.
When I click on the windows link it takes me to a google drive. Sorry if I am being dense, but what do I do then? So is this no longer available?
In reply to When I click on the windows… by bharper
As explained above, no, this experiment never really went anywhere.
In reply to When I click on the windows… by bharper
You are not dense, certainly not.
I have the same question and problem.
What do they mean to download?
We are musicians, not programmers.
In reply to You are not dense, certainly… by gpermant
Why is this Announcement "NEW Feature: Auto-converting images and PDFs to the MuseScore" still online if the development has been discontinued?
Your are grossly misleading music lovers the world over, and waking false hopes.
The entire thread should be taken offline.
In reply to Why is this Announcement … by gpermant
Forums are an ongoing record of everything that has transpired, not a snapshot of a single point in time. it's the nature of a forum that a post from a year ago talks about how things were then, and a post from 10 years ago talks about how things were back them. It's not really cool to go back and try to change history, it's much better to keep the record.
I attempted to convert several .pdf files and none of them worked. Not as magical as I had hoped. :(
In reply to I attempted to convert… by Craigditz
I'm guessing you weren't using the experimental test version of MuseScore being discussed here, but instead the ordinary web service provided by musescore,com using Audiveris. Indeed, it's not that magical, but what was being proposed here was something completely different was definitely pretty promising - it just never really panned out, so the project as far as I know was abandoned. See the original message to understand how vastly different it was going to be.
How do I use this on Windows?
In reply to How do I use this on Windows? by Piotr Barcz
You don't :-(. Unfortunately, this experiment never made it out of the laboratory.
In reply to You don't :-(. … by Marc Sabatella
Oh, that's really too bad, this could be an amazing tool...
In reply to You don't :-(. … by Marc Sabatella
will it ever come back?
In reply to will it ever come back? by yaraklou367
There is nothing of that code left. Never say never, but there are programs way better and specialized for this for the time being.
It can't read the PDFs. I dunno what's wrong with it but it doesn't work
After download, the program runs and sees the pdf files, but can not open them... :( Usually it failes to open any pdf file... Did I do something wrong or the program is still incomplete?
Pls help!
In reply to After download, the program… by Menya
This was an incomplete developer experiment that got scrapped.
Hi! how can I add this feature to my Musescore? :)
In reply to Hi! how can I add this… by yonathanshter
Unfortunately, this was an experiment that never went further than a nice-looking demo. Maybe someday the work will be continued.
In reply to Unfortunately, this was an… by Marc Sabatella
I hope someone continues with it, I think an easier alternative might be to simple make the score transparent and then import a PDF that would have the MuseScore staves superimposed and aligned with the PDF so that typesetting by sight would be easier.
In reply to I hope someone continues… by Piotr Barcz
Getting even the systems aligned would be tricky and the notes and text even more difficult given the wide range of styles that scores come in. And having the notes in the pdf right where you want to enter them in Musescore (even if it could be achieved) would be rather irritating. Much better to have the pdf in a separate window above, below or to the side.
In reply to Getting even the systems… by SteveBlower
that's actually how I typeset scores often and it's worse because I get confused as to which measure I'm working on and then I have to go back and insert measures and do other nasty stuff to correct the mistakes. At least having the systems right above or below the stave being typeset would make things easier.
In reply to that's actually how I… by Piotr Barcz
I find it easier to work from a hard copy. You can tick off the measures with a pencil (remember those? :-) )as you enter them.