Yeah you can, I downloaded command line tools for my OS X (10.8.5) from the Developer Downloads area. However I still got this error after "make":
cc -I"/Applications/Pd-extended.app/Contents/Resources/include/pd" -DPD -DVERSION='"0.0"' -arch ppc -arch i386 -arch x86_64 -mmacosx-version-min=10.4 -fPIC -I/sw/include -Wall -W -g -ftree-vectorize -ftree-vectorizer-verbose=2 -fast -o "vphasor~.o" -c "vphasor~.c"
clang: error: unknown argument: '-ftree-vectorizer-verbose=2' [-Wunused-command-line-argument-hard-error-in-future]
clang: note: this will be a hard error (cannot be downgraded to a warning) in the future
make: *** [vphasor~.o] Error 1
I'm gonna go ahead and install xCode 5.1 and then try installing command line tools again from there.
Cheers.