I am doing a project. where i am mixing 2 vids (that bit done). I have a patch created that streams the wav of the video to an array (this bit also working). However if i launch the sound file as a subpatch and then launch the video, once the vid is launched the sound goes all wonky. How do I keep them in sync? I'd also ideally like to have sound files playing simultaneously if possible? I include a dropbox link to my patches, data files etc

https://www.dropbox.com/sh/r6t665axnccrzbt/AACR0CyLJxpf9oYIfN5UK_gca?dl=0

My project is due super-soon and I've only been learning pd for about 4 weeks so any help would be very much appreciated!!

@whale-av it still sounds really staggered. the main wav is the self. the vantastival meant to loop thats why i had the metro as opposed to an auto on it, with a metro it will just play ad infinitum until the movie is destroyed. i actually would like to give the user the option of playing either sound and leave the user with a choice of turning one of the vids off (thats why i had toggles on the two gemheads, which seem redundant now?) and would like to give the option of toggling the sound file so it can play one or the other. Myabe this will clarify. top notch editing though, learning a lot!

@musicproject one easy thing to try is to put audio latency (buffer) way up, E.g. 200ms
EDIT: sorry, if this answer is a little unrelatet, i didn't read the whole thread very carefully. My suggestion was for crackling in the audio when using DSP and GEM in the same patch

@musicproject Ok....... not exactly what you want so please come back if you need help again. The video will loop.
I found two problems in your audio objects...... the expression object with 48000 in it will play at the wrong speed if the computer soundcard is set at 44100...... so I have put in an auto bit using [samplerate~]. That will also help fix the playback speed.
Also you were sending "sampleRate" using that same name in both audio patches, so they were talking to each other....... I have separated them by adding $0- at the beginning of the names which makes them unique for each patch........ that caused one of your problems!
I have not used the "choice"....... in fact I have not used "soundchooser33" at all...... I have put an audio fader in the main window instead..... it can all be changed again so let me know if that's good/bad....
fix34.zip
David.

@whale-av thanks. the rate was recorded at 48000. i recorded it myself. Just downloading your zip now. I've been at it for hours, gonna take a break!

@musicproject Yes....... it helps if your patch gets put on a Mac which is set to 44100..... it will automatically correct........ !breaks are a good idea!......
David.

@whale-av your updated vsn works quite well, but the self track doesn't play well. other than that everything mixes and everything. Some comments to explain what you did would be nice; vantastival plays ok. Just se;lf not syncing. thats my main problem

@musicproject I have added a delay to the start of the speech video. It is adjustable, but I think the delay of the audio is because (as always) the editor added 2 seconds of silence to the beginning when the audio was stripped from the video........they do that so that there is a pause between tracks......assuming that you are going to press a cd...... old world technology bleeds into the modern world.

I will write in explanations of what I have done and why to the patch....... but its time for bed and my daughters birthday tomorrow...... so probably on Sunday. Post what you finish up using back to me (not the av files) and I will annotate that as you might have changed something.

The first time it runs the videos it is out of sync. Restarting them puts them in sync. The audio files you have were stripped out at 44100Hz which means that they will not play at the right speed on your machine, and so will drift out, but every video restart will resync the beginning of the tracks.

It might be possible to do a fake start at loadbang so that when you press the start button they have already started once........ and so could be in sync.
fix35.zip
David.

@musicproject Daughter not out of bed so......... annotated a bit and false start added so as to (hopefully) have everything synced when you start the videos.
By the way, the volumes in your audio patches only affect the left channel of the tracks. I have left that as it is maybe intentional.
fix36.zip
David.

@whale-av hi David, I really appreciate all the effort you put into helping me. Unfortunately the sound doesn't sync on my machine. I've tried it on a mac and it doesn't sync there either. I'll try alternative routes (stackoverflow/my lecturer) for advice as I don't seem to be getting anywhere.

Thanks again.

Rachel

@musicproject Hello Rachel....... I played around this morning and watched the video to the end.
As I thought earlier the audio player is playing faster than the video. That can be corrected automatically using the extended version of Pd...... but to keep things simple you must resample your audio tracks at 48000Hz to match the video samplerate and the samplerate of your soundcard. If you have no audio editor that can do this I can upload and send you a link..... at the moment your videos are at 48kHz and your audio tracks at 44.1kHz.
Also...... here is a simpler audio player that might help with the cpu load....... fix37.zip
David.

@whale-av Actually when i watch the vid the audio plays much slower than the video. I have adobe audition and i have already resampled the tracks. Like i say, nothing seems to be working. What machine are you working on that this seems to magically work?

@musicproject I am running Pd-extended under windows7 on a MacBook Pro mid-2012. I will look at a total rebuild from scratch..... as I cannot see what might cause this. It certainly runs "ok-ish" on my machine.
David.

its a little simplistic considering the whole 2 sounds (which i want to be able to switch between - not into mixing them) and the 2 mixed videos, but its a start.

Got it from http://amphibiousthoughts.com/blog/pd-video-player-with-sound

Rach

@musicproject new link is https://www.dropbox.com/sh/w6z1qz7txfwi9e1/AAAniXdKZtgajTloLVJ0TVhva?dl=0

@musicproject Hello.......... yes I had been playing with that idea. Your mp4 files do not report their length correctly in frames on my computer........ so that cannot work, and also an end bang is never produced by [pix_film]...... for the same reason.......
They can only be played with "auto 1".
Try this>> dunno.zip
Any avi files that I have tried that report their length correctly can be controlled........
I am trying some file conversions......... I think yours must be compressed at a variable framerate...... which needs to be converted to fixed.
That could explain the sync issues......... and with luck you will need to change nothing else in your patch....... a BIG
David.

@whale-av i tried that last zip out a while ago and no joy either. I actually found a zip online of someone who claimed to have synced a video and sound, patch and all, and got very excited. The video ended WAY before the sound! Daniel someone.. its a pure data old spice thing .. google it. I joined a google plus pd community, checked out the websites of the people posting frequently and sent many emails. I think i've emailed everyone but santa claus asking for help now, lol! Ah well, gonna go in and use the college macs tomorrow, see if it makes a difference.

Thanks for all your help, i reallly do appreciate it!!

Rach
p.s. found it http://www.openobject.org/physicalprogramming/Daniel's_Pure_Data_Media_Player_-_PROJECT_2

@musicproject Hello Rachel.... The more I play with formats the more I am convinced that uncompressed avi is the only format that will work with the "sync" that you found. I have tested it with an avi film that I made and I can varispeed it without problems.. I don't know if you have that option though......(uncompressed avi)........
I really must get working with Premiere Pro again....... but way too rusty........
Anyway, I took your talking heads video and set it as constant frame rate using Mpeg Streamclip...... which is free here.........http://www.squared5.com/
Using the option to save as an mp4, but selecting the whole movie and fixing it first...... "edit" "select all" "Fix Time Code Breaks..." the movie produced should work better with the patch (constant frame rate). It still doesn't bang at the end, so no immediate loop solution....... but it should play in sync once........
You can produce an avi with that program as well..... but whether it would be better I don't know....
David.

@whale-av Hi, I am a bit of an expert in Premiere Pro. I re-exported the movie at 960x540 size instead of 1920x1080 and adjusted the audio to 44100. I am currently uploading it to dropbox. Why AVI? an mp4 with those settings should work fine. I'll share the movie once it's uploaded, but am defo gonna hit the college labs tomorrow.

Goodnight!

Rach

p.s. Talking heads video? lol!

@whale-av https://www.dropbox.com/s/tnwvysoa4abvuek/DEFINITION.mp4?dl=0

@whale-av said:

@musicproject as @EEight says you might need two instances of Pd to run that properly.

“The [pd~] object starts and manages a Pd sub-process… …In this way you can take advantage of multi-core CPUs,”

mtl/examples/gems-movies_with_sound~
https://github.com/patricksebastien/mtl/tree/master/examples