Difference between revisions of "Youtube"

From Blue-IT.org Wiki

(→‎Youtube upload script)
 
Line 501: Line 501:
  
 
[[Category:Ubuntu]]
 
[[Category:Ubuntu]]
−
[[Category:Audio and Video]]
+
[[Category:Audio, Video]]

Latest revision as of 08:25, 10 January 2015

Youtube upload script

Thanks to an article on the german website "Linux und ich" , I decided to make my own upload script. I makes heavy usage of the source code provide youtube-upload.py, a python script. It also uses the split-tool provided in the examples directory!

Legal notice

This script is given AS IS. I am not responsible for loss of data (which is really not what I want and not likely to happen). But furthermore I am not responsible, if your google data is hacked using an insecure network or given away your data otherwise or using the third party software youtube-upload used by this script.

Prerequisites

  • have an ogv video (gtkRecordMyDesktop), e.g myvideo_name.ogv
  • you like to convert and upload it to Youtube using Nautilus (or in batch mode in bash)
  • provide your Youtube account data (which are the same like for google) in the code of the script
  • login into youtube in your browser (this will open you video page, when the script finished)
  • prepare a file named e.g. myvideo_name.meta - if you like - in the same directory as the video with the following content:
TITLE="Your title here"
DESCRIPTION="Description here"
# Valid categories: Tech Education Animals People Travel Entertainment Howto Sports Autos Music News Games Nonprofit Comedy Film
CATEGORY="Category here"
KEYWORDS="Keywords (colon separated here)"

It will be used for uploading the file. If you don't have such a file, a new one will be created when you enter your data (you will be asked)

  • have split_video_for_youtube.sh in your path and youtube_upload.py somewhere (get it here: youtube-uploade at google code )
  • have a wrapperfile called youtube-upload in your path:
#!/bin/bash
python /wherever/is/youtube_upload.py "${@}"

in your path, and made them executable (chmod +x filename)!!!

  • have mencoder installed

This is a nautilus script, can be turned into normal script

Put the given script into 

~/gnome2/nautilus-scripts

and make it executable. 

chmod +x scriptname

Beeing a nautilus script it can be easily turned into shell script changing the line 

cd "$NAUTILUS_SCRIPT_CURRENT_URI"

into 

cd "$(pwd)"

This might be also handy for troubleshooting!!!

If you like to like to make everything without interaction, you can alter the last part of the script beginning with: 

if [ -f ${MYBASENAME}.part*.${MYCONVTYPE} ]
then
# Converted video exists

delete it until the end and substitude it with: 

[ -f ${MYBASENAME}.meta ] || set_youtube_metadata
split_it
upload_it

This way the script will run through without asking you.

So here we go

#!/bin/bash

# Convert any given Video to a youtube compatible format ... and upload it
# Uses https://code.google.com/p/youtube-upload/ to upload to youtube

#########################################################################################
# Edit to your need

# Create a file containing your youtube data, and chmod 600, so only you
# can read it. See an example in line 18.
# Probably later I will include a dialog.
MY_YOUTUBE_ACCOUNT_DATA_FILE="/home/${USER}/.youtube-account-data"

# Valid Youtube categories:
VALID_CATEGORY="Tech Education Animals People Travel Entertainment Howto Sports Autos Music News Games Nonprofit Comedy Film"

# Do not edit after this line
#########################################################################################
# Content of MY_YOUTUBE_ACCOUNT_DATA_FILE
YOUTUBE_EMAIL="myname@googlemail.com"
YOUTUBE_PASSWORD="secret_password"
YOUTUBE_CHANNEL="MyChannelName"
[ -f "${MY_YOUTUBE_ACCOUNT_DATA_FILE}" ] && source "${MY_YOUTUBE_ACCOUNT_DATA_FILE}"
[ -f "${MY_YOUTUBE_ACCOUNT_DATA_FILE}" ] || zenity --error --text "There is not Youtube account data!!!\n\nProvide a file ${MY_YOUTUBE_ACCOUNT_DATA_FILE}"
[ -f "${MY_YOUTUBE_ACCOUNT_DATA_FILE}" ] || exit 1

########################################################################################
## Change this for toggling beeing a bash-script or a nautilus-script
DEBUGMODE="${2}"
[ "$DEBUGMODE" = "--debug" ] && DEBUG=1
[ $DEBUG ] && zenity --info --title "DEBUG-MODE" --text "Running in debugging mode."

[ $DEBUG ] || cd "$NAUTILUS_SCRIPT_CURRENT_URI"
[ $DEBUG ] && cd "$(pwd)"


MYCONVTYPE="mkv"	  # Used by the split tool, don't change
MYFILE="${1}"
#MYFILE_ORIG=""
[ $DEBUG ] && zenity --info --title "DEBUG-MODE" --text "DEBUG:\n\nInputfile: \"${MYFILE}\"\nFiletype: \"$(file "${MYFILE}")\""

# Detox it - filename correction
MYFILE_CORRECTED=""
if which detox
then
	#MYFILE_ORIG="${MYFILE}"
	MYFILE_CORRECTED="$(detox -v "${MYFILE}" | grep -v "Scanning" | cut -d'>' -f2 | sed -e 's/ //g')"
	[ "${MYFILE_CORRECTED}" = "" ] || MYFILE="${MYFILE_CORRECTED}"
	[ $DEBUG ] && zenity --info --text "Detoxed filename in var MYFILE: ${MYFILE}"
else
	if zenity --question --text "<detox> is not installed.\n\nDo you like to install it first and then repeat?"
	then
		exit 1
	else
		MYFILE_CORRECTED="$(echo "${MYFILE}" | sed -e 's/\:/-/g' | sed -e 's/\&/_and_/g' | sed -e 's/,/_-_/g' )"
		mv "${MYFILE}" "${MYFILE_CORRECTED}" && sync
		MYFILE="${MYFILE_CORRECTED}"
	fi
fi
if echo "${MYFILE}" | grep -v grep | grep ".part001"
then
	MYFILE_CORRECTED="$(echo "${MYFILE}" | sed -e 's/.part001//g')"
	mv "${MYFILE}" "${MYFILE_CORRECTED}" && sync
	MYFILE="${MYFILE_CORRECTED}"
fi

VIDEOTYPE_IS_OK="false"
file "${MYFILE}" | grep -v grep | grep ".ogv: Ogg data"  && VIDEOTYPE_IS_OK="true"
file "${MYFILE}" | grep -v grep | grep ".ogg: Ogg data"  && VIDEOTYPE_IS_OK="true"
file "${MYFILE}" | grep -v grep | grep ".mkv: data" && VIDEOTYPE_IS_OK="true"
file "${MYFILE}" | grep -v grep | grep ".mp4:" && VIDEOTYPE_IS_OK="true"
MYTYPE=""
file "${MYFILE}" | grep -v grep | grep ".ogg: Ogg data"  && MYTYPE="ogg"
file "${MYFILE}" | grep -v grep | grep ".ogv: Ogg data"  && MYTYPE="ogv"
file "${MYFILE}" | grep -v grep | grep ".mkv: data" && MYTYPE="mkv"
file "${MYFILE}" | grep -v grep | grep ".mp4:" && MYTYPE="mp4"


if [ "${MYTYPE}" = "" ]
then
	zenity --error --text "Dateitypzuordnung inkorrekt. Wahrscheinlich konnte der Dateiname nicht gelesen werden"
	exit 1
fi

MYBASENAME="$(basename "${MYFILE}" .${MYTYPE})"
TITLE="Titel hinzufügen..."
DESCRIPTION="Beschreibung hinzufügen..."
CATEGORY="Howto"
KEYWORDS="Stichwörter (kommagetrennt)..."

############################################################################
# Split vidwo
VIDEO_COUNT=0
split_it() {
	
        if test split_video_for_youtube.sh ${MYBASENAME}.${MYTYPE}
	then
		echo "Files splitted ..."
	else
		if [ "${MYTYPE}" = "mkv" ]
		then		
			# no conversion, but move to special pattern ...
			mv "${MYBASENAME}.${MYTYPE}" "${MYBASENAME}.part001.${MYCONVTYPE}"

		        notify-send  "Konvertierung nicht notwendig" \
		                -i /local/share/icons/kino.png \
		                "Das Video ${MYBASENAME} wird jetzt hochgeladen."

		else
	  		# FFmpeg tries it best preserving the quality
			# If ffmpeg fails, mencoder will be used
			if ffmpeg -y -i "${MYBASENAME}.${MYTYPE}" \
				-vcodec mpeg4 -acodec libfaac -sameq \
				"${MYBASENAME}.part001.${MYCONVTYPE}"
			then
			        notify-send  "Konvertierung erfolgreich" \
			                -i /local/share/icons/kino.png \
			                "Das Video ${MYBASENAME} wird jetzt hochgeladen."
			else
				# Mencoder produces smaller files, but I had some troubles with audio synchronisation
				if mencoder ${MYBASENAME}.${MYTYPE} -o ${MYBASENAME}.part001.${MYCONVTYPE} -oac mp3lame -ovc lavc
				then
				        notify-send  "Konvertierung erfolgreich" \
			                -i /local/share/icons/kino.png \
			                "Das Video ${MYBASENAME} wird jetzt hochgeladen."
				else

				        notify-send  "Konvertierung fehlgeschlagen" \
			                -i /local/share/icons/kino.png \
			                "Das Video ${MYBASENAME} konnte nicht konvertiert werden!"

				zenity --info --text "Versuchen sie in einem Terminal:\n\nffmpeg -i ${MYBASENAME}.${MYTYPE} -vcodec mpeg4 -acodec libfaac -sameq ${MYBASENAME}.part001.${MYCONVTYPE}"
				exit 1
				
				fi
			fi
		fi
	fi

	VIDEO_COUNT=$(ls "${MYBASENAME}.part"*.${MYCONVTYPE} | wc | awk '{print $1}')
}

upload_it() {

COUNT=$VIDEO_COUNT
while ( [ $COUNT -gt 0 ] );
do

	UPLOAD_FILE=""

	if [ $VIDEO_COUNT -eq 1 ]
	then PART=""
	else PART=" - Part $COUNT - $VIDEO_COUNT"
	fi
	echo "Uploading ${COUNT} file(s) ..."

	youtube-upload 	--email="${YOUTUBE_EMAIL}" \
			--password="${YOUTUBE_PASSWORD}" \
			--title="${TITLE}${PART}" \
			--description="${DESCRIPTION}" \
			--category="${CATEGORY}" \
			--keywords="${KEYWORDS}" \
			"${MYBASENAME}.part"*${COUNT}.${MYCONVTYPE} | \
	zenity  --progress --auto-close --pulsate --no-cancel \
                --title "Lade hoch ..." \
                --text  "Lade ${MYBASENAME}${PART} auf Youtube hoch ..." && \
        notify-send  "Hochladen von Videodatei" \
                -i /local/share/icons/ktorrent.png \
                "Hochladen von ${MYBASENAME}.${PART} erfolgreich."

	if [ $VIDEO_COUNT -eq 1 ] 
	then
		[ - f "${MYBASENAME}.part001.${MYCONVTYPE}" ] && mv "${MYBASENAME}.part001.${MYCONVTYPE}" "${MYBASENAME}.${MYCONVTYPE}"
	fi

	COUNT=$(expr $COUNT - 1)
	echo "COUNT is: $COUNT"
done

sync

# If you like to delete the generated videos for upload, uncomment the following

# If the input was an mkv-file , don't delete it
 "${MYTYPE}" = "mkv" ] || rm -f ${MYBASENAME}.part*.${MYCONVTYPE}

# Channel
#exec firefox "http://www.youtube.com/user/${YOUTUBE_CHANNEL}/videos" &

# You have to be logged in to see this site:
exec firefox "http://www.youtube.com/my_videos?feature=mhee" &

}

set_youtube_metadata() {

	if [ -f "${MYBASENAME}.meta" ] 
	then
		source "${MYBASENAME}.meta"
	else
		echo "TITLE=\"${TITLE}\"" > "${MYBASENAME}.meta"
		echo "DESCRIPTION=\"${DESCRIPTION}\"" >> "${MYBASENAME}.meta"
		echo "# Valid categories: ${VALID_CATEGORY}"  >> "${MYBASENAME}.meta"
		echo "CATEGORY=\"${CATEGORY}\"" >> "${MYBASENAME}.meta"
		echo "KEYWORDS=\"${KEYWORDS}\"" >> "${MYBASENAME}.meta"
		
		source "${MYBASENAME}.meta"
	fi

}

edit_metadata() {

	[ -f "${MYBASENAME}.meta" ] ||  set_youtube_metadata
	[ -f "${MYBASENAME}.meta" ] &&  source "${MYBASENAME}.meta"
	
	TITLE="$(zenity --entry --text "Titel:" --entry-text="${TITLE}")"
	echo "TITLE=\"${TITLE}\"" > "${MYBASENAME}.meta"
	DESCRIPTION="$(zenity --text "Beschreibung:" --entry --entry-text="${DESCRIPTION}")"
	echo "DESCRIPTION=\"${DESCRIPTION}\"" >> "${MYBASENAME}.meta"
        echo "# Valid categories: ${VALID_CATEGORY}"  >> "${MYBASENAME}.meta"
	CATEGORY="$(zenity --text "Kategorie:\n\n${VALID_CATEGORY}" --entry --entry-text="${CATEGORY}")"
	echo "CATEGORY=\"${CATEGORY}\"" >> "${MYBASENAME}.meta"
	KEYWORDS="$(zenity --text "Stichwörter:" --entry --entry-text="${KEYWORDS}")"
	echo "KEYWORDS=\"${KEYWORDS}\"" >> "${MYBASENAME}.meta"
	
}


###################################
# Main
if [ "${VIDEOTYPE_IS_OK}" = "true" ]
then
	echo "Filecheck OK"
else
	zenity --info --title "Fehler" --text "Dies scheint keine \"${MYTYPE}\"- oder \"${MYCONVTYPE}\"-Datei zu sein! Bitte überprüfen.\n\nAusgabe \"$(file \"${MYFILE}\")\""
	exit 0
fi

# Edit metadata
EDIT_META="false"
if test -f "${MYBASENAME}.meta"
then
	source "${MYBASENAME}.meta"
	zenity  --question --title "Metadata" \
		--text "Do you like to edit THE EXISTING file containing the Youtube-Metadata?\n\nTitel: ${TITLE}" \
		&& EDIT_META="true"
else
        zenity  --question --title "Metadata" \
                --text "There is not Metadatafile yes. Do you like to edit containing the Youtube-Metadata? Otherwise default values are used." \
                && EDIT_META="true"
fi

if [ "${EDIT_META}" = "true" ]
then
	edit_metadata
else
	set_youtube_metadata
fi

# Check if a mkv already exists
MKV_EXISTS="false"
[ -f "${MYBASENAME}.part*.${MYCONVTYPE}" ] && MKV_EXISTS="true"
[ -f "${MYBASENAME}.${MYTYPE}" ] && MKV_EXISTS="true"

if [ "${MKV_EXISTS}" = "true" ]
then
# Converted video exists
	if zenity --question --title "Existierendes Video auf Youtube hochladen" \
		--text "Umwandlung war nicht nöti: Existierunde Datei ${MYBASENAME}.${MYCONVTYPE} jetzt auf Youtube hochladen?\n\nMetadaten:\nTitel: ${TITLE}"
	then
		split_it
		upload_it
	else
		exit 0
	fi
else
# Converted video does not exist

if zenity --question --title "Video konvertieren und auf Youtube hochladen?" \
	--text "${MYBASENAME}.${MYTYPE} in ${MYCONVTYPE} umwandeln und auf Youtube hochladen?\n\nTitel: ${TITLE}"
then

	[ -f "${MYBASENAME}.meta" ] || set_youtube_metadata

	split_it
	upload_it

fi

fi

Youtube download script

This exists: 

sudo apt-get install youtube-dl

Download an entire channel: 

youtube-dl -citw ytuser:<USER>

Download al videos of a playlist: 

youtube-dl -citw <PLAYLIST URL>
youtube-dl -citw "http://www.youtube.com/view_play_list?p=PL12345238475092835"

Download a video: 

youtube-dl -citw <VIDEO URL>
youtube-dl -citw http://www.youtube.com/watch?v=111aaaYYYjjj


Batch-processing: 

youtube-dl -citw -a "myVideo.list"

vim myVideo.list

http://www.youtube.com/watch?v=111aaaYYYjjj
http://www.youtube.com/playlist?p=PL12345238475092835
ytuser:mySpecialUser

and convert erverything to audio: 

youtube-dl -citwk -a "myVideo.list" --extract-audio --audio-format mp3

Batch-convert videos with avidemux

Avidemux is a very handy tool. Sometimes you have a lot of files of the same type laying around and you like to apply all the same filters to them. I use it to convert the videos form my camera (mov) into a compatible format for e.g. Openshot (avi).

The solution is very simple. There is a tool called avidemux_cli (command line interface). It can use the project-files created with the Avidemux graphical user interface. Simply save your settings with Avidemux-GUI to a file with the ending ".proj" alongside with your videos and run the follwoing script.

Special version for a certain project

There are only some things to edit:

  • a folder name where to save the converted files
  • the name of the video filetype to be converted (here mp4)
  • the name of the output video, this MUST match the type given in avidemux
  • the exact name of the avidemuxproject-file

For the script to run you need to install avidemux-cli and avidemux: 

sudo apt-get install avidemux-cli avidemux

#!/bin/bash
FOLDER="Converted"
IN_TYPE="mp4"
OUT_TYPE="avi"
PROJECT="convert_to_mjpeg.proj"

##########################################

mkdir -p $FOLDER

cat "${PROJECT}" | \
fgrep -v app.load  | \
fgrep -v app.clearSegments  | \
fgrep -v app.addSegment  | \
fgrep -v app.markerA  | \
fgrep -v app.markerB \
> "${PROJECT}.cli"

cat "${PROJECT}.cli"

BASE=""
for InputItem in *.${IN_TYPE}
do 
	#BASE="$(basename $InputItem .${IN_TYPE})"
	BASE="$(basename $InputItem)"
	avidemux2_cli --load  "$InputItem" --run "$PROJECT.cli" --save "${FOLDER}/${BASE}.${OUT_TYPE}" 
done

General purpose version

I also created a version for batch processing and general purpose: 

#!/bin/bash

which avidemux2_cli > /dev/null || echo "Please install: sudo apt-get install avidemux-cli"
which avidemux2_cli > /dev/null || exit 1

[ "$4" ] || cat <<EOF

 USAGE: $(basename $0) 
		<OUTPUT_FOLDER_NAME> 
		<IN_TYPE OUT_TYPE> 
		<OUTPUT_FILETYPE> 
		<AVIDEMUX_PROJECT_FILE_NAME>

 e.g.

 $> $(basename $0) ConvertedFiles mp4 avi myavidemux.proj

EOF

[ "$1" ] || exit 1
[ "$2" ] || exit 1
[ "$3" ] || exit 1
[ "$4" ] || exit 1

FOLDER="$1"
IN_TYPE="$2"
OUT_TYPE="$3"
PROJECT="$4"
LOGFILE="conversion.log"

##########################################

mkdir -p $FOLDER

cat "${PROJECT}" | \
fgrep -v app.load  | \
fgrep -v app.clearSegments  | \
fgrep -v app.addSegment  | \
fgrep -v app.markerA  | \
fgrep -v app.markerB \
> "${PROJECT}.cli"

cat "${PROJECT}.cli"

BASE=""
ERROR="0"
for InputItem in *.${IN_TYPE}
do 
BASE="$(basename $InputItem .$IN_TYPE)"

cat <<EOF
#######################################################################
#######################################################################
## avidemux2_cli 
## --load  "$InputItem"
## --run "$PROJECT.cli" 
## --save "${FOLDER}/${BASE}.${OUT_TYPE}
##
EOF

avidemux2_cli --load  "$InputItem" --run "$PROJECT.cli" --save "${FOLDER}/${BASE}.${OUT_TYPE}" || ERROR="1"

cat <<EOF
#######################################################################

EOF

done

[ "$ERROR" = "1" ] && zenity --info --title "Conversion ended" --text "There have been ERRORS" 
[ "$ERROR" = "0" ] && zenity --info --title "Conversion ended" --text "OK"

Changelog

  • [Update] Changed converter from mencoder to ffmpeg due to audio sync problems - --Apos 01:49, 6 January 2012 (CET)
  • [Update] Major version update of script - --Apos 04:33, 6 January 2012 (CET)
Retrieved from "https://wiki.blue-it.org/index.php?title=Youtube&oldid=5450"