Before, when you want to hear and write what you are talking about, upload it to YouTube, wait for about an hour, the caption will be created automatically, then download the caption file with .str / .sbv etc., and then I corrected the mistakes using subtitle editing editor with excellent functions such as **Subtitle Edit** or **Aegisub** , and when I finished editing, I exported it as a text file.
rf.
京都大学 河原研究室 音声認識を用いた自動字幕
Captioning System based on Automatic Speech Recognition Technology
http://caption.ist.i.kyoto-u.ac.jp/
rf.
中島敏フォトアーカイブ・解題 (Photo archive "KAIDAI")
https://project.log.osaka/nakajima/
rf.
Nikolaj Lynge Olsson's 'Subtitle Edit'
https://nikse.dk/
rf.
Aegisub github page
https://github.com/Aegisub/Aegisub
... It looks like it will be evening by the time we get there.
Take out a video on YouTube that already has subtitles (it doesn't matter what language it is, but I'm assuming it's in English in this article), and it feels a bit better than the result of YouTube's automatic translation.It is for getting the translation result in text.
There is a lot of way for improvement.
If you look at the code, the contents of this program are the same. If you don't understand, you can uncomment it and see what it is by print('what_you_want_to_know'), so I think you should change what you want to do (by yourself). This project is mostly programmed and verified only with Amazon kindle Fire8 2020 (Android OS of 6500 yen), so it has the disadvantage of a small screen, but I think it can be done on a smartphone as long as the internet and browser support googlecolab.
The reason why it is googlecolab has merit, but it is not clear yet, so I will not write it clearly. One of the advantages is that the IP address can be changed easily. By the way, the IP address of the googlecolab notebook is
!curl ipecho.net/plain
https://ipecho.net/developers.html
Please note that this is a free service, provided as-is with out any warranty.
I know the links have to be consistent so they will probably never change, I'll also try to keep the uptime as close to 100% as possible, but again, I can't offer any warranty for anything and I reserve the right to do whatever I please with it, so you're using the service at your own risk.
If you're planning to use this service in an application you might consider using this link instead: http://ipecho.net/plain
PS: Please don't abuse the system, try to cache the IP for a reasonable amount of time before doing another request, so everyone can enjoy it.
It seems that you can check it. Thus there seems to be a way to use googlecolab locally.
If you concatenate 2 program codes and specify the URL of the target YouTube video as urltext, it will automatically pick up the subtitle text and googletrans will process the fetched text. I intended to display the results of YouTube automatic translation and google translate API side by side in order to compare them, but when I tried and confirmed some, After trying a few things, it seemed that YouTube automatic translation was no different from google translate by concatenating two lines of captions (for example, the original English text) into one line.Ignore it and put three lines into one line, two lines into one line, two lines into one line, and so on to get the meaning processing of long sentences that machine learning is good at. I'm passing it to the google translate API.
Sometimes I want to compare it with another machine translation, so I split the process into two parts: getting the subtitle text from YouTube and concatenating the lines, and google translate the text. If you add a program again, you can batch process from the list of URLs.
Of course, it can be done on Android OS (pydroid3 checked, but QPython gave an error.) The following code assumes that you are using googlecolab, so you will need to rewrite it a bit. However, it shouldn't be too difficult, and I think it's almost the same for jupyter notebook. (I don't know, I haven't done it yet. I'd like to migrate and check it out soon, but I've lost hours installing jupyter in QPython and failed in the end, so I don't have a path to a jupyter test environment)
#1 Subtitle
youtube_transcript_api (0.3.1)
pip install youtube_transcript_api
from youtube_transcript_api import YouTubeTranscriptApi
#from googletrans import translator
from google.colab import files
#import time
#import sys
from urllib.parse import urlparse, parse_qs
urltext ='https://www.youtube.com/watch?v=P9GLDezYVX4' ## YouTube URL
args = [urltext]
video_id = ''
def extract_video_id(url):
query = urlparse(url)
if query.hostname == 'youtu.be': return query.path[1:]
if query.hostname in {'www.youtube.com', 'youtube.com'}:
if query.path == '/watch': return parse_qs(query.query)['v'][0]
if query.path[:7] == '/embed/': return query.path.split('/')[2]
if query.path[:3] == '/v/': return query.path.split('/')[2]
# fail?
return None
for url in args:
video_id = (extract_video_id(url))
print('youtube video_id:',video_id)
## youtube video_id
line =[]
line[:] = YouTubeTranscriptApi.get_transcript(video_id,languages=['en']) ## if YouTube subtitle is English
text_list = [] # subtitle text lines
for l in line:
##print("text: ", l['text'])
##print("start:", l['start'])
##print("duration:", l['duration'])
l['text']=l['text'].strip() # chop empty charactor
l['text']=l['text'].rstrip('\n') # chop charactor
l['text']=l['text'].rstrip('\r') # chop charactor
l['text']=l['text'].replace('\r','') # cut charactor
l['text']=l['text'].replace('\n',' ') # cut charactor
text_list.append(l['text'])
##text_list[:] = [a for a in text_list if a != ' '] ## same as above
##text_list[:] = [l.replace('\n',' ') for l in text_list]
##print(line)
del line
##print(text_list)
original_stdout = sys.stdout ## stdout backup
filename = 'subtitle.txt' ## print subtitle text to this file
with open(filename, 'w') as f:
sys.stdout = f # stdout to file
print('youtube video_id:',video_id)
print()
print("haywhnk-A.K.A-@dauuricus")
print("- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -")
print("YouTube captions")
print("- - - - - - - - - - - - - - - - - - - YouTube - - - - - - - - - - - - - - - - - - -")
print()
print()
line = YouTubeTranscriptApi.list_transcripts(video_id)
transcript = line.find_transcript(['en']) ## select English subtitle
#print(transcript.fetch())
## caption_line =[]
## for count, dict_obj in enumerate(transcript.fetch()):
## print( dict_obj['text'] )
## caption_line.append(dict_obj['text'])
## print()
## print()
## print("************************************************************************************")
## print()
## print("- - - - - - - - - - - - - - - - - - translated - - - - - - - - - - - - - - - - - - -")
## print()
## print()
## translated = transcript.translate('ja')
## for count, dict_obj in enumerate(translated.fetch()):# japanese
## print( count+1, dict_obj['text'] )
## print()
## print("-----------------------------------------------------------------------------------")
## print()
## print("text compositimg ...")
## print("- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -")
## print()
## print()
#### text_e = [] ##2 lines to 1 line
#### i = 0
#### txt_e = ''
#### for count,l in enumerate(caption_line):
#### if i == 0:
#### txt_e += l
### i = i + 1
### text_e.append(txt_e)
### elif i == 1:
### txt_e += ' ' +l
### text_e.pop()
### text_e.append(txt_e)
### i = 0
### txt_e = ''
def line_edit2(textlines): ##2 lines to 1 line same as line_edit1(textlines)
text_compo = []
txt = ''
for count,l in enumerate(textlines):
if (count+1)%2 == 0:
txt = text_compo.pop()
txt += ' ' +l
text_compo.append(txt)
else :
txt = l
text_compo.append(txt)
return text_compo
def line_edit3(textlines): ##3 lines to 1 line
text_compo = []
txt = ''
i = 0
for count,l in enumerate(textlines):
if i == 0:
txt += l
i = i + 1
text_compo.append(txt)
elif i == 1:
txt = text_compo.pop()
txt += ' ' + l
i = i + 1
text_compo.append(txt)
elif i == 2:
txt = text_compo.pop()
txt += ' ' + l
text_compo.append(txt)
txt = ''
i = 0
return text_compo
def line_edit1(textlines): ##2 lines to 1 line
text_compo = []
i = 0
txt = ''
for count,l in enumerate(textlines):
if i == 0:
txt += l
i = i + 1
text_compo.append(txt)
elif i == 1:
txt += ' ' +l
text_compo.pop()
text_compo.append(txt)
i = 0
txt = ''
return text_compo
### text_compo = [] ##2 lines to 1 line
### i = 0
### txt = ''
### for count,l in enumerate(text_list):
### if i == 0:
### txt += l
### i = i + 1
### text_compo.append(txt)
### elif i == 1:
### txt += ' ' +l
### text_compo.pop()
### text_compo.append(txt)
### i = 0
### txt = ''
### print()
### print()
### print("************************************************************************************")
### print()
### print()
## for count, l in enumerate(text_list):
## print(count+1,' ',l)
print()
print()
print("************************************************************************************")
print("shrink text")
print()
#### for count, l in enumerate(text_e):
#### print(count+1,l)
print()
print()
text_compo = (line_edit3(text_list))
text_compo[:] = (line_edit2(text_compo))
#for count, l in enumerate(text_compo):
# print(l)
text_compo2 = (line_edit2(text_compo))
text_compo2[:] = (line_edit2(text_compo2))
for count, l in enumerate(text_compo2):
print(l)
print()
print()
print()
print("************************************************************************************")
print()
print("Thank you.")
sys.stdout = original_stdout # stdout back
##files.download(filename) ## if you want to download file
Run program ...
Now you get YouTube subtitle in your google drive which google colab can read.
cf.extracting youtube video id from youtube URL
https://qiita.com/dauuricus/private/9e70c4c25566fedb9c19
#2 Translate
googletrans==4.0.0-rc
pip install googletrans==4.0.0-rc
from google.colab import files
from googletrans import Translator
import sys
#import re
#####uploaded = files.upload()
####filename = ''
####for fn in uploaded.keys():
#### print('User uploaded file "{name}" with length {length} bytes'.format(
#### name=fn, length=len(uploaded[fn])))
#### filename = fn
filename = 'subtitle.txt'
#args= sys.argv
args = [('translate.py'),filename]
print('open '+args[1])
with open(args[1]) as f: # uploaded file
line = f.readlines()
f.close()
line[:] = [l.strip() for l in line]
line[:] = [l.rstrip('\n') for l in line]
line[:] = [a for a in line if a != '']
line[:] = [l.replace('\n',' ') for l in line]
line[:] = [l.replace('\r',' ') for l in line]
#print(line)
#print()
####for line_num,l in enumerate(line):
#### if re.search(r'.*?i'm$',l):
#### print(line_num,' ',l)
#### elif re.search(r'.*?to/Z',l):
#### print(line_num,' ',l)
#### if re.search(r'.*?the$',l):
#### print(line_num,' ',l)
#### elif re.search(r'.*?the/Z',l):
#### print(line_num,' ',l)
#for line_num,l in enumerate(line):
# print(line_num,' ',l)
translator = Translator()
num = 20
#obj_num = 1
filename = 'translated.txt'
backup_stdout = sys.stdout
print("translating...")
with open(filename,'w') as f:
sys.stdout = f
for count, l in enumerate(line):
if count < 7:
continue
else:
if count +1< num:
translated = translator.translate(l, dest='ja')
##print(count+1,' ', l) # original text
print(translated.text)
else:
translated = translator.translate(l, dest='ja')
##print(count+1,' ', l) # original text
print(translated.text)
del translator
num = num + 20
#obj_num = obj_num + 1
#print("")
#print("--- translator :", obj_num)
#print("")
translator = Translator()
sys.stdout = backup_stdout # back
del translator
print("saving...",filename)
#files.download(filename) # translated.txt
Language list
| 'af': 'afrikaans' | 'sq': 'albanian' | 'am': 'amharic' | 'ar': 'arabic' |
| 'hy': 'armenian' | 'az': 'azerbaijani' | 'eu': 'basque' | 'be': 'belarusian' |
| 'bn': 'bengali' | 'bs': 'bosnian' | 'bg': 'bulgarian' | 'ca': 'catalan' |
| 'ceb': 'cebuano' | 'ny': 'chichewa' | 'zh-cn': 'chinese (simplified)' | 'zh-tw': 'chinese (traditional)' |
| 'co': 'corsican' | 'hr': 'croatian' | 'cs': 'czech' | 'da': 'danish' |
| 'nl': 'dutch' | 'en': 'english' | 'eo': 'esperanto' | 'et': 'estonian' |
| 'fi': 'finnish' | 'fr': 'french' | 'fy': 'frisian' | 'gl': 'galician' |
| 'ka': 'georgian' | 'de': 'german' | 'el': 'greek' | 'gu': 'gujarati' |
| 'ht': 'haitian creole' | 'ha': 'hausa' | 'haw': 'hawaiian' | 'iw': 'hebrew' |
| 'he': 'hebrew' | 'hi': 'hindi' | 'hmn': 'hmong' | 'hu': 'hungarian' |
| 'is': 'icelandic' | 'ig': 'igbo' | 'id': 'indonesian' | 'ga': 'irish' |
| 'it': 'italian' | 'ja': 'japanese' | 'jw': 'javanese' | 'kn': 'kannada' |
| 'kk': 'kazakh' | 'km': 'khmer' | 'ko': 'korean' | 'ku': 'kurdish (kurmanji)' |
| 'ky': 'kyrgyz' | 'lo': 'lao' | 'la': 'latin' | 'lv': 'latvian' |
| 'lt': 'lithuanian' | 'lb': 'luxembourgish' | 'mk': 'macedonian' | mg': 'malagasy' |
| 'ms': 'malay' | 'ml': 'malayalam' | 'mt': 'maltese' | 'mi': 'maori' |
| 'mr': 'marathi' | 'mn': 'mongolian' | 'my': 'myanmar (burmese)' | 'ne': 'nepali' |
| 'no': 'norwegian' | 'or': 'odia' | 'ps': 'pashto' | 'fa': 'persian' |
| 'pl': 'polish' | 'pt': 'portuguese' | 'pa': 'punjabi' | 'ro': 'romanian' |
| 'ru': 'russian' | 'sm': 'samoan' | 'gd': 'scots gaelic' | 'sr': 'serbian' |
| 'st': 'sesotho' | 'sn': 'shona' | 'sd': 'sindhi' | 'si': 'sinhala' |
| 'sk': 'slovak' | 'sl': 'slovenian' | 'so': 'somali' | 'es': 'spanish' |
| 'su': 'sundanese' | 'sw': 'swahili' | 'sv': 'swedish' | 'tg': 'tajik' |
| 'ta': 'tamil' | 'te': 'telugu' | 'th': 'thai' | 'tr': 'turkish' |
| 'uk': 'ukrainian' | 'ur': 'urdu' | 'ug': 'uyghur' | 'uz': 'uzbek' |
| 'vi': 'vietnamese' | 'cy': 'welsh' | 'xh': 'xhosa' | 'yi': 'yiddish' |
| 'yo': 'yoruba'a | 'zu': 'zulu' |