hey thanks alot for that. i just got it sorta working. i didnt realize you could do it with sigmund. i was thinking that only did like monophonic pitch tracking and id have to use the fft object or something, but sigmund can track about 16 partials. which is good enough for now, i can always split incoming signal into more bands and add more sigmund objects if i need to. way easier than i expected.

Hello
I am completely new to PD and am coming to it for a very specific midi utility id like to create but have no idea where to start.
Im looking to create a tool that takes realtime mic input , analyzes all the spectrum with FFT and spits out midi . not pitch tracking, but the pitch and volume/pitch of each bin to be resynthesized outside of PD.

a basic example of what im talking about is what peter arblinger did with his "phonorealism" stuff, which he built a pd patch to do this exact thing. https://cdm.link/2009/10/the-speaking-piano-and-transforming-audio-to-midi/

i would love for any suggestions of patches that either already exist or resources to help me learn where to get started. thank you !