https://www.youtube.com/watch?v=7_IEdMv9eFE
================================================================================
Page source:
Initial HTML
Can be changed by JavaScript
Browser dev tool
Changed form by JavaScript
================================================================================
When you can see data from "page source",
you can use request.
================================================================================
Use "header" information
import requests
url="url"
headers={
"Referer":"http://comic.naver.com/webtoon/...",
"User-Agent":"user_string"}
res=requests.get(url,headers=headers)
================================================================================
# tag=a, attribute=href, href contains jsMemPop
# soup.select('a[href*=jsMemPop]')
for tag in soup.select('a[href*=jsMemPop]'):
print(tag.text)