Curl or Wget

[Vapid - BANNED FOR LIFE]

What do you prefer

[EddyTheDog]

Curl....

[Vapid - BANNED FOR LIFE]

#1 curl ^

[HomerSimpson]

cURL

[fris]

curl from php/ruby/python,etc

use curl and wget from console

[bns666]

wget , using it from shell only.

[ottopottomouse]

curl + php

[V_RocKs]

depends on what I am doing...

[AndrewX]

Originally Posted by V_RocKs

depends on what I am doing...

From console wget is easier to use and is available even when curl is not installed (yet).

[seeandsee]

Curl i guess :D

[Stann]

wget from shell

[Killswitch]

Originally Posted by fris

curl from php/ruby/python,etc

use curl and wget from console

[JamesM]

for downloading wget from shell.,

for doing automation curl and php.

[shake]

As most others have said, curl for programming, wget is a nice program to use on it's own from the command line.

[idolbucks]

wget -i list.txt is nice for dl'ing a huge list of things

[moeloubani]

im actually in the early stages of planning something here and im thinking of using curl but still trying to figure out how to do what i need to do with it

basically i need to use a login form on one site to log into another site - easy
then i need to display what was on that other site onto the new site - easy

the tricky part is i want to change the links on the new site and on the page gathered from the old one so that when someone clicks on them they stay on the new site instead of navigating out

any ideas? maybe set up some sort of iframe after the initial login? i have access to both sites

[AutumnBH]

Same as everyone else, curl + php or wget from the command line...

However the other day I was scraping an ebook archive. I used curl + php to scrape the html pages and get the actual pdf urls. Then in the next stage I downloaded all the pdfs using a shell script. However I found some hosts would issue a 206 error (partial content) when using wget. I ended up having to use curl from the command line to get the goods.

[MrCain]

Wget from the shell. CURL in PHP.

[pornsprite]

wget with perl and the command line curl with php

[fris]

Here is an example i did recently with wget

#!/bin/bash

# grab images from fishki.net blog posts

if [ $# -ne 1 ]
then
	echo "fishki.net url to grab images needed."
	exit
fi

if [[ "$1" == http://fishki.net/comment.php?id=* ]]
then
	echo "downloading..."
	dir=`date "+%Y-%m-%d_%H:%M"`;
	wget -r -p -q -nd -e robots=off -P images_$dir -A '*.jpg' -R 'tn.jpg' -H -D 'ru.fishki.net' $1
	echo -n "images saved: " ; ls images_$dir/ | grep ".jpg" -c
else
	echo "invalid url: must contain http://fishki.net/comment.php?id=xxxxx"
fi
exit 64
;;
esac

;)

[mafia_man]

http://aria2.sourceforge.net/

[fris]

get the latest 20 popular images from 500px.com

for line in `wget --quiet -O- http://500px.com/popular | grep "from=popular" | sed -n 's/.*<img src="\([^"]*\)".*/\1/p' | sed s/"3.jpg"/"4.jpg"/ | sed s/"?t".*$//`; do wget -O $RANDOM.jpg --quiet "$line"; done

[VenusBlogger]

I'm suprised so much people here are programmers...

so where are the people that never used CURL+WGET?

You dont wonder or ask why they use it? Are you not curious at all?

Maybe its something that could be helpful and help in your webmaster tasks.. but nobody that never used it jumps into this thread, im very surprised... No curiosity? NOBODY?... That's how humans discover things, with curiosity...

I personally used WGET in SSH before, but only a few times.

[Miguel T]

cURL all the way!

[CYF]

wget for command line, curl for scripts and stuff.

[edgeprod]

I don't think I've ever used curl OUTSIDE of a script, or wget INSIDE of one, so I see them as environment-based tools. I've been coding cURL stuff all weekend, so I'd definitely say I use cURL a lot more FREQUENTLY, if that's the question.

The answer of "this or that" is usually "the right tool for the job" .. so what's the job?

[sandman!]

wget.....