Can you open a headless browser with webbrowser? Announcing the arrival of Valued Associate #679: Cesar Manara Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern) Data science time! April 2019 and salary with experience The Ask Question Wizard is Live!How can I safely create a nested directory in Python?How can I remove a trailing newline in Python?How do you split a list into evenly sized chunks?How do you change the size of figures drawn with matplotlib?How can I make a time delay in Python?How can you profile a Python script?How do you read from stdin?How do you append to a file in Python?Is there a way to use Python to check the url of the currently opened browser?Calling pythons webbrowser without stderr and in headless mode
A journey... into the MIND
Trying to enter the Fox's den
Married in secret, can marital status in passport be changed at a later date?
Proving inequality for positive definite matrix
How to create a command for the "strange m" symbol in latex?
Why does my GNOME settings mention "Moto C Plus"?
/bin/ls sorts differently than just ls
How to keep bees out of canned beverages?
How to ask rejected full-time candidates to apply to teach individual courses?
Coin Game with infinite paradox
Suing a Police Officer Instead of the Police Department
How to leave only the following strings?
Converting a text document with special format to Pandas DataFrame
What helicopter has the most rotor blades?
Raising a bilingual kid. When should we introduce the majority language?
What kind of equipment or other technology is necessary to photograph sprites (atmospheric phenomenon)
Pointing to problems without suggesting solutions
Why not use the yoke to control yaw, as well as pitch and roll?
Who's this lady in the war room?
Kepler's 3rd law: ratios don't fit data
Im stuck and having trouble with ￢P ∨ Q Prove: P → Q
Can gravitational waves pass through a black hole?
Help Recreating a Table
Sorting the characters in a utf-16 string in java
Can you open a headless browser with webbrowser?
Announcing the arrival of Valued Associate #679: Cesar Manara
Planned maintenance scheduled April 23, 2019 at 23:30 UTC (7:30pm US/Eastern)
Data science time! April 2019 and salary with experience
The Ask Question Wizard is Live!How can I safely create a nested directory in Python?How can I remove a trailing newline in Python?How do you split a list into evenly sized chunks?How do you change the size of figures drawn with matplotlib?How can I make a time delay in Python?How can you profile a Python script?How do you read from stdin?How do you append to a file in Python?Is there a way to use Python to check the url of the currently opened browser?Calling pythons webbrowser without stderr and in headless mode
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty height:90px;width:728px;box-sizing:border-box;
I was just wondering if it's possible to open a headless browser with the webbrowser module? I'm new to programming and have virtually no experience and don't even know where to look. I heard this is a good site to start. I wanted to use the webbrowser module because I'm planning to run the program on other computers and the average person doesn't have special software like chrome drivers installed on their computers, also webbrowser doesn't require a PATH to open a browser window. So I wanted to use it. If anyone knows any other alternative modules that can open common browsers without needing a PATH please say so.
python
asked Mar 9 at 2:53
Some_dudeSome_dude
184
add a comment |
I was just wondering if it's possible to open a headless browser with the webbrowser module? I'm new to programming and have virtually no experience and don't even know where to look. I heard this is a good site to start. I wanted to use the webbrowser module because I'm planning to run the program on other computers and the average person doesn't have special software like chrome drivers installed on their computers, also webbrowser doesn't require a PATH to open a browser window. So I wanted to use it. If anyone knows any other alternative modules that can open common browsers without needing a PATH please say so.
python
asked Mar 9 at 2:53
Some_dudeSome_dude
184
You should explain why you want to use thewebbrowsermodule, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?
– Basile Starynkevitch
Mar 9 at 3:40
add a comment |
I was just wondering if it's possible to open a headless browser with the webbrowser module? I'm new to programming and have virtually no experience and don't even know where to look. I heard this is a good site to start. I wanted to use the webbrowser module because I'm planning to run the program on other computers and the average person doesn't have special software like chrome drivers installed on their computers, also webbrowser doesn't require a PATH to open a browser window. So I wanted to use it. If anyone knows any other alternative modules that can open common browsers without needing a PATH please say so.
python
asked Mar 9 at 2:53
Some_dudeSome_dude
184
I was just wondering if it's possible to open a headless browser with the webbrowser module? I'm new to programming and have virtually no experience and don't even know where to look. I heard this is a good site to start. I wanted to use the webbrowser module because I'm planning to run the program on other computers and the average person doesn't have special software like chrome drivers installed on their computers, also webbrowser doesn't require a PATH to open a browser window. So I wanted to use it. If anyone knows any other alternative modules that can open common browsers without needing a PATH please say so.
python
python
asked Mar 9 at 2:53
Some_dudeSome_dude
184
asked Mar 9 at 2:53
Some_dudeSome_dude
184
edited Mar 9 at 4:12
Some_dude
asked Mar 9 at 2:53
Some_dudeSome_dude
184
asked Mar 9 at 2:53
Some_dudeSome_dude
184
asked Mar 9 at 2:53
Some_dudeSome_dude
184
184
You should explain why you want to use thewebbrowsermodule, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?
– Basile Starynkevitch
Mar 9 at 3:40
add a comment |
You should explain why you want to use thewebbrowsermodule, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?
– Basile Starynkevitch
Mar 9 at 3:40
You should explain why you want to use the
webbrowser module, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?– Basile Starynkevitch
Mar 9 at 3:40
You should explain why you want to use the
webbrowser module, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?– Basile Starynkevitch
Mar 9 at 3:40
add a comment |
2 Answers
2
active
oldest
votes
Most modules have a so-called API documentation. For the webbrowser module, it can be found here: https://docs.python.org/3.6/library/webbrowser.html
If you come across a module of which you cannot find any documentation, try help() in iPython:
import webbrowser
help(webbrowser) # help for module
help(webbrowser.get) # help for function
browser = webbrowser.get()
help(browser) # help for browser object
There one can see, that this is no documented feature for the webbrowser module. Nevertheless, there are other modules that you might want to look into - this list seems to be a good start https://github.com/dhamaniasad/HeadlessBrowsers
Btw. to respond to Basile Starynkevitch (I have not yet enough reputation to add a comment under other posts): A headless browser might process JavaScript and follow HTML forwarding. You will not get the same from the software you mentioned.
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.links)
– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
linksis a "full" browser which does not process JavaScript.
– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
|
show 1 more comment
Wrong terminology: a headless browser should be more generally called some HTTP client. Read much more about HTTP and take time to understand what should happen in the HTTP clients and what should happen in the HTTP servers. Be also aware of HTML5, JavaScript, AJAX and other web technologies. They are related in their usage within a usual browser such as Firefox, but conceptually independent.
Of course, your typical browser is an HTTP client, but there are many other HTTP clients (e.g. wget or any program using libcurl, which is a good free software HTTP client library or web crawlers).
Some browsers (e.g. links) can be much more crude than your typical one, but all browsers are HTTP clients. They might not even know about JavaScript or CSS (or not even show any image). They still deserve to be called "browsers". Some programs (e.g. selenium) reproduce many functions of typical browsers (even JavaScript or CSS) but don't show anything on a screen. You might call them headless browsers but they might not even claim being one.
And Python includes some HTTP client (and also HTTP server) functions.
You could find other HTTP server libraries, such as libonion.
Many programs use HTTP (outside of browsing, e.g. as inter-process communication). Be aware of web services.
PS. That is the first time I read about headless browsers, so I don't think this terminology is very common.
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
add a comment |
Your Answer
StackExchange.ifUsing("editor", function ()
StackExchange.using("externalEditor", function ()
StackExchange.using("snippets", function ()
StackExchange.snippets.init();
);
);
, "code-snippets");
StackExchange.ready(function()
var channelOptions =
tags: "".split(" "),
id: "1"
;
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function()
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled)
StackExchange.using("snippets", function()
createEditor();
);
else
createEditor();
);
function createEditor()
StackExchange.prepareEditor(
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader:
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
,
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
);
);
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55073560%2fcan-you-open-a-headless-browser-with-webbrowser%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
2 Answers
2
active
oldest
votes
2 Answers
2
active
oldest
votes
active
oldest
votes
active
oldest
votes
Most modules have a so-called API documentation. For the webbrowser module, it can be found here: https://docs.python.org/3.6/library/webbrowser.html
If you come across a module of which you cannot find any documentation, try help() in iPython:
import webbrowser
help(webbrowser) # help for module
help(webbrowser.get) # help for function
browser = webbrowser.get()
help(browser) # help for browser object
There one can see, that this is no documented feature for the webbrowser module. Nevertheless, there are other modules that you might want to look into - this list seems to be a good start https://github.com/dhamaniasad/HeadlessBrowsers
Btw. to respond to Basile Starynkevitch (I have not yet enough reputation to add a comment under other posts): A headless browser might process JavaScript and follow HTML forwarding. You will not get the same from the software you mentioned.
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.links)
– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
linksis a "full" browser which does not process JavaScript.
– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
|
show 1 more comment
Most modules have a so-called API documentation. For the webbrowser module, it can be found here: https://docs.python.org/3.6/library/webbrowser.html
If you come across a module of which you cannot find any documentation, try help() in iPython:
import webbrowser
help(webbrowser) # help for module
help(webbrowser.get) # help for function
browser = webbrowser.get()
help(browser) # help for browser object
There one can see, that this is no documented feature for the webbrowser module. Nevertheless, there are other modules that you might want to look into - this list seems to be a good start https://github.com/dhamaniasad/HeadlessBrowsers
Btw. to respond to Basile Starynkevitch (I have not yet enough reputation to add a comment under other posts): A headless browser might process JavaScript and follow HTML forwarding. You will not get the same from the software you mentioned.
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.links)
– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
linksis a "full" browser which does not process JavaScript.
– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
|
show 1 more comment
Most modules have a so-called API documentation. For the webbrowser module, it can be found here: https://docs.python.org/3.6/library/webbrowser.html
If you come across a module of which you cannot find any documentation, try help() in iPython:
import webbrowser
help(webbrowser) # help for module
help(webbrowser.get) # help for function
browser = webbrowser.get()
help(browser) # help for browser object
There one can see, that this is no documented feature for the webbrowser module. Nevertheless, there are other modules that you might want to look into - this list seems to be a good start https://github.com/dhamaniasad/HeadlessBrowsers
Btw. to respond to Basile Starynkevitch (I have not yet enough reputation to add a comment under other posts): A headless browser might process JavaScript and follow HTML forwarding. You will not get the same from the software you mentioned.
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
Most modules have a so-called API documentation. For the webbrowser module, it can be found here: https://docs.python.org/3.6/library/webbrowser.html
If you come across a module of which you cannot find any documentation, try help() in iPython:
import webbrowser
help(webbrowser) # help for module
help(webbrowser.get) # help for function
browser = webbrowser.get()
help(browser) # help for browser object
There one can see, that this is no documented feature for the webbrowser module. Nevertheless, there are other modules that you might want to look into - this list seems to be a good start https://github.com/dhamaniasad/HeadlessBrowsers
Btw. to respond to Basile Starynkevitch (I have not yet enough reputation to add a comment under other posts): A headless browser might process JavaScript and follow HTML forwarding. You will not get the same from the software you mentioned.
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
edited Mar 9 at 3:16
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
answered Mar 9 at 3:11
mythenmetzmythenmetz
856
856
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.links)
– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
linksis a "full" browser which does not process JavaScript.
– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
|
show 1 more comment
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.links)
– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
linksis a "full" browser which does not process JavaScript.
– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.
links)– Basile Starynkevitch
Mar 9 at 3:18
Yep. You wrote: might process. And some browsers don't process JavaScript (e.g.
links)– Basile Starynkevitch
Mar 9 at 3:18
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
Totally agree. I just wanted to answer to your statement "Wrong terminology", as "headless browser" is a terminology that is commonly used.
– mythenmetz
Mar 9 at 3:21
links is a "full" browser which does not process JavaScript.– Basile Starynkevitch
Mar 9 at 3:23
links is a "full" browser which does not process JavaScript.– Basile Starynkevitch
Mar 9 at 3:23
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
Again, I totally agree that there are (also headless) browsers that do not process JavaScript. Nevertheless the terminology "headless browser" is not wrong.
– mythenmetz
Mar 9 at 3:26
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
BTW, that is the first time I am hearing of "headless browser". So I don't think that terminology is so common. A browser has by definition a human user. And a headless server has no screen.
– Basile Starynkevitch
Mar 9 at 3:34
|
show 1 more comment
Wrong terminology: a headless browser should be more generally called some HTTP client. Read much more about HTTP and take time to understand what should happen in the HTTP clients and what should happen in the HTTP servers. Be also aware of HTML5, JavaScript, AJAX and other web technologies. They are related in their usage within a usual browser such as Firefox, but conceptually independent.
Of course, your typical browser is an HTTP client, but there are many other HTTP clients (e.g. wget or any program using libcurl, which is a good free software HTTP client library or web crawlers).
Some browsers (e.g. links) can be much more crude than your typical one, but all browsers are HTTP clients. They might not even know about JavaScript or CSS (or not even show any image). They still deserve to be called "browsers". Some programs (e.g. selenium) reproduce many functions of typical browsers (even JavaScript or CSS) but don't show anything on a screen. You might call them headless browsers but they might not even claim being one.
And Python includes some HTTP client (and also HTTP server) functions.
You could find other HTTP server libraries, such as libonion.
Many programs use HTTP (outside of browsing, e.g. as inter-process communication). Be aware of web services.
PS. That is the first time I read about headless browsers, so I don't think this terminology is very common.
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
add a comment |
Wrong terminology: a headless browser should be more generally called some HTTP client. Read much more about HTTP and take time to understand what should happen in the HTTP clients and what should happen in the HTTP servers. Be also aware of HTML5, JavaScript, AJAX and other web technologies. They are related in their usage within a usual browser such as Firefox, but conceptually independent.
Of course, your typical browser is an HTTP client, but there are many other HTTP clients (e.g. wget or any program using libcurl, which is a good free software HTTP client library or web crawlers).
Some browsers (e.g. links) can be much more crude than your typical one, but all browsers are HTTP clients. They might not even know about JavaScript or CSS (or not even show any image). They still deserve to be called "browsers". Some programs (e.g. selenium) reproduce many functions of typical browsers (even JavaScript or CSS) but don't show anything on a screen. You might call them headless browsers but they might not even claim being one.
And Python includes some HTTP client (and also HTTP server) functions.
You could find other HTTP server libraries, such as libonion.
Many programs use HTTP (outside of browsing, e.g. as inter-process communication). Be aware of web services.
PS. That is the first time I read about headless browsers, so I don't think this terminology is very common.
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
add a comment |
Wrong terminology: a headless browser should be more generally called some HTTP client. Read much more about HTTP and take time to understand what should happen in the HTTP clients and what should happen in the HTTP servers. Be also aware of HTML5, JavaScript, AJAX and other web technologies. They are related in their usage within a usual browser such as Firefox, but conceptually independent.
Of course, your typical browser is an HTTP client, but there are many other HTTP clients (e.g. wget or any program using libcurl, which is a good free software HTTP client library or web crawlers).
Some browsers (e.g. links) can be much more crude than your typical one, but all browsers are HTTP clients. They might not even know about JavaScript or CSS (or not even show any image). They still deserve to be called "browsers". Some programs (e.g. selenium) reproduce many functions of typical browsers (even JavaScript or CSS) but don't show anything on a screen. You might call them headless browsers but they might not even claim being one.
And Python includes some HTTP client (and also HTTP server) functions.
You could find other HTTP server libraries, such as libonion.
Many programs use HTTP (outside of browsing, e.g. as inter-process communication). Be aware of web services.
PS. That is the first time I read about headless browsers, so I don't think this terminology is very common.
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
Wrong terminology: a headless browser should be more generally called some HTTP client. Read much more about HTTP and take time to understand what should happen in the HTTP clients and what should happen in the HTTP servers. Be also aware of HTML5, JavaScript, AJAX and other web technologies. They are related in their usage within a usual browser such as Firefox, but conceptually independent.
Of course, your typical browser is an HTTP client, but there are many other HTTP clients (e.g. wget or any program using libcurl, which is a good free software HTTP client library or web crawlers).
Some browsers (e.g. links) can be much more crude than your typical one, but all browsers are HTTP clients. They might not even know about JavaScript or CSS (or not even show any image). They still deserve to be called "browsers". Some programs (e.g. selenium) reproduce many functions of typical browsers (even JavaScript or CSS) but don't show anything on a screen. You might call them headless browsers but they might not even claim being one.
And Python includes some HTTP client (and also HTTP server) functions.
You could find other HTTP server libraries, such as libonion.
Many programs use HTTP (outside of browsing, e.g. as inter-process communication). Be aware of web services.
PS. That is the first time I read about headless browsers, so I don't think this terminology is very common.
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
edited Mar 9 at 13:23
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
answered Mar 9 at 3:06
Basile StarynkevitchBasile Starynkevitch
180k13175376
180k13175376
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
add a comment |
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
(Sorry if I sound stupid, as said I'm very new to tech) So basically, what I think you said is that not all browsers can process javascript, but HTTP clients can? If I'm correct, I just wanted to know if some of the HTTP clients I can find will be able to access sites on the internet as a browser would, like for example would a HTTP client be able to go somewhere like youtube?, also the Wikipedia page for HTTP looks a bit overwhelming, I'm fine with reading it and doing more research on my own, but before I did that I just wanted to know if you knew any more beginner friendly sites?
– Some_dude
Mar 9 at 3:50
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
I did not wrote that most HTTP clients can process JavaScript. I did wrote that some browsers can't.
– Basile Starynkevitch
Mar 9 at 7:18
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function ()
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f55073560%2fcan-you-open-a-headless-browser-with-webbrowser%23new-answer', 'question_page');
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function ()
StackExchange.helpers.onClickDraftSave('#login-link');
);
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
You should explain why you want to use the
webbrowsermodule, and why do you want a headless browser (and not just some HTTP client). In particular, explain more precisely what you'll do with HTML and other contents. What would you do with images on the Web?– Basile Starynkevitch
Mar 9 at 3:40