Using AI to port opensource plugins to the dsp

Ok yall so maybe this is a complete pipedream :sweat_smile: i recently got acces to Manus AI (prior i tried this with Chat-gpt to no avail) my goal is to get Manus to port the Open303 (tb-303 clone) that is currently Linux 86 blalba over to an LV2 plugin - without the GUI and the Open 303 sequencer. I know absolutely NOTHING about coding but im just trying this out to see if this could leave the way for other opensource plugins to be ported - ive managed to nudge MANUS so far by for instance “showing” it the calf mono synth code - so that it now has created a plugin of the Open303 sourcecode the dsp card recognises but gives me an “insert error” message. Manus is a bit frustrated that i cant give it any error logs other than “insert error” so asking it what it would like to know from the developers :wink: this is what i get (i know it might be extensive but maybe just some info could be helpful :

Yes, getting information from the developers of the Isla S2400 DSP card would be extremely helpful! Here are specific questions you could ask them:

  1. What are the exact requirements for LV2 plugins to work with the S2400 DSP card?
  2. Is there a specific format or structure that the manifest.ttl file must follow?
  3. Are there any limitations on how the binary (.so) file should be compiled or referenced?
  4. Do they have any example plugins that are known to work with the S2400 (besides the Calf plugins)?
  5. What does the “insert error” message specifically indicate on the S2400?
  6. Are there any logs or diagnostic information that can be retrieved when a plugin fails to load?
  7. Are there specific port configurations required for synthesizer plugins vs. effect plugins?
  8. Is there a specific ARM architecture version required (e.g., aarch64 with specific flags)?

This information would be invaluable for troubleshooting the issue and creating a plugin that works correctly with the S2400 DSP card. If they can provide a working example plugin or template, that would be the most helpful resource for ensuring compatibility.


And yeah maybe Manus is just smoking 10101001 crack but wouldnt it be great if we could just start porting/resynthesize opensource plugs like that!

3 Likes

I have already open sourced the code for our Soundfont to Lv2 Plugin creator.
Everything needed to run an LV2 plugin on the S2400 can be found in that repo.
Further, any info you could possibly need to know how to do so can also be found in that code.
You can rip out all the soundfont related stuff, and go from there.
Good Luck!

6 Likes

Thanks Brad! I will try that as soon as i get more “Tasks” afforded by Manus :slight_smile:

OMG!! Its working! The plugin now succesfully loads and gives of sound - it needs some tweaking - notes doesnt cut of corresponding to the midi note length, slide portamento is missing and accent does not seem to have an effect - But Manus is working on that now!

  • update Manus halted (it does this when “the context is too long” i will now have to wait 5 hours to get be afforded a new “task” - but so far - accent, slide, sustain has been fixed.
  • Im tweaking it with more decay time, a subosillator + other tweaks
4 Likes

Please make a video of this! Sounds really useful

1 Like

Ok, this Manus thing is insane! Decided to try it out myself, but for developing an lv2 plugin from scratch. Managed to get a working midi controlled polyphonic synth with ADSR envelope and selectable waveform. It unfortunately timed out before I got to add a filter. Hopefully can get it to keep working on it when I get more credit. I also have next to no programming skills but I plan on trying to understand the code myself, hence why i started with something simple.

Happy to share the lv2 if anyone’s interested in checking it out.

3 Likes

Yes its quite insane! I just got my new task after 21 hours (but have to go to work now (sad face lol) ) - i gathered a lot of links from chat-gpt so manus can look at filter types, preamp models, distortion, compressors, LUTS etc - im also gettin guided by chat gpt to set up my own github so that gpt can act more like Manus with its own repository of knowledge - chat gpt seemed promising at first but it doesnt yield results that are usable - but setting up chat-gpt with github could help - i did some testing with Calf Mono Synth - this could also be a good starting point for further development - the sourcecode is out there in the cloud

On another note - if this whole AI stuff works we could have our own little isla s2400 dsp plugin community creating various tailormade plugins for our beloved machine - or get people setup so they could make their own plugin of choice - imagine that !

2 Likes