It moves along with the threaded part (is that my crank?) in and out maybe a quarter inch or so.
Yes that is your crank snout, don't damage it.
if it moves together then your flywheel is not loose on the crank, it'd also be back firing as the timing would be off so that's not it.
Maybe video the noise and post it up on youtube and post a link to it here.