Everything that concerns curl. Questions, bug reports, scripts and related tools and subjects welcome

Daniel Stenberg | 1 Sep 2008 17:16

ANNOUNCE: Curl and libcurl 7.19.0

Hello friends!

I'm happy and proud to bring yet another release of curl and libcurl. Get your 
own copy of it from: http://curl.haxx.se/download.html

Curl and libcurl 7.19.0

  Public curl releases:         106
  Command line options:         127
  curl_easy_setopt() options:   153
  Public functions in libcurl:  58
  Known libcurl bindings:       36
  Contributors:                 654

This release includes the following changes:

  o curl_off_t gets its size/typedef somewhat differently than before. This _may_
    cause an ABI change for you. See lib/README.curl_off_t for a full explanation.

  o Added CURLINFO_PRIMARY_IP
  o Added CURLOPT_CRLFILE and CURLE_SSL_CRL_BADFILE
  o Added CURLOPT_ISSUERCERT and CURLE_SSL_ISSUER_ERROR
  o curl's option parser for boolean options reworked
  o Added --remote-name-all
  o Now builds for the INTEGRITY operating system
  o Added CURLINFO_APPCONNECT_TIME
  o Added test selection by key word in runtests.pl
  o the curl tool's -w option support the %{ssl_verify_result} variable
  o Added CURLOPT_ADDRESS_SCOPE and scope parsing of the URL according to RFC4007
  o Support --append on SFTP uploads (not with OpenSSH, though)

(Continue reading)

headers

hanane hanane | 2 Sep 2008 10:42

Hello

this my problem:
I must add that such an option: - warc as options that already exist: - o

this new option (-warc) save html code to records(warc file).

And I need to know how you treat options and what are the function which manages the option - o (OUTPUT )

thanks.........

Tous vos amis discutent sur Messenger, et vous ? Téléchargez Messenger, c'est gratuit !

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

hanane hanane | 2 Sep 2008 10:44

Hello

this my problem:
I must add that such an option: - warc as options that already exist: - o

this new option (-warc) save html code to records(warc file).

And I need to know how you treat options and what are the function which manages the option - o (OUTPUT )

thanks.........

Téléchargez le nouveau Windows Live Messenger ! Téléchargez Messenger, c'est gratuit !

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

hanane hanane | 2 Sep 2008 10:50

Hello

this my problem:
I must add that such an option: - warc as options that already exist: - o

this new option (-warc) save html code to records(warc file).

And I need to know how you treat options and what are the function which manages the option - o (OUTPUT )

thanks.........

Appelez vos amis de PC à PC -- C'EST GRATUIT Téléchargez Messenger, c'est gratuit !

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

Daniel Stenberg | 2 Sep 2008 11:15

Re: Hello

On Tue, 2 Sep 2008, hanane hanane wrote:

> this my problem: I must add that such an option: - warc as options that 
> already exist: - o this new option (-warc) save html code to records(warc 
> file). And I need to know how you treat options and what are the function 
> which manages the option - o (OUTPUT )thanks.........

You've now asked the same question multiple times on the curl-library list and 
on this list and I've now set you as "moderated" on this list (which stopped 
more of your identical mails).

When you ask specific questions about this that show that you're even capable 
of performing this task, I will answer to the best of my knowledge.

And when you do, use a sensible subject line. Thanks!

Until then I will just not let your mails through.

--

-- 

  / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

Jade Rubick | 2 Sep 2008 18:24

Corruption with uploads using sftp

Thanks for your reply, Daniel.

Here is the details with debugging on:

$ !809
/usr/local/bin/curl --user user:password --upload-file /web/vs/files/shared/public/solr-vs--lucene--server--solr--vs-ae-vsg-part-1-14533565-bid10253233741-10253233695-10099.xml -v sftp://my.host.com/

* About to connect() to my.host.com port 22 (#0)
* Trying 1.2.3.4... connected
* Connected to my.host.com (1.2.3.4) port 22 (#0)

* SFTP 0x99a3af8 state change from SSH_STOP to SSH_S_STARTUP
* SFTP 0x99a3af8 state change from SSH_S_STARTUP to SSH_AUTHLIST

* SSH authentication methods available: publickey,password

* SFTP 0x99a3af8 state change from SSH_AUTHLIST to SSH_AUTH_PKEY_INIT

* Using ssh public key file /home/jade/.ssh/id_dsa.pub
* Using ssh private key file /home/jade/.ssh/id_dsa

* SFTP 0x99a3af8 state change from SSH_AUTH_PKEY_INIT to SSH_AUTH_PKEY

* SSH public key authentication failed: Unable to open public key file

* SFTP 0x99a3af8 state change from SSH_AUTH_PKEY to SSH_AUTH_PASS_INIT
* SFTP 0x99a3af8 state change from SSH_AUTH_PASS_INIT to SSH_AUTH_PASS
* Initialized password authentication
* SFTP 0x99a3af8 state change from SSH_AUTH_PASS to SSH_AUTH_DONE
* Authentication complete
* SFTP 0x99a3af8 state change from SSH_AUTH_DONE to SSH_SFTP_INIT
* SFTP 0x99a3af8 state change from SSH_SFTP_INIT to SSH_SFTP_REALPATH
* SSH CONNECT phase done
* SFTP 0x99a3af8 state change from SSH_SFTP_REALPATH to SSH_STOP
* DO phase starts
* SFTP 0x99a3af8 state change from SSH_STOP to SSH_SFTP_QUOTE_INIT
* SFTP 0x99a3af8 state change from SSH_SFTP_QUOTE_INIT to SSH_SFTP_TRANS_INIT
* SFTP 0x99a3af8 state change from SSH_SFTP_TRANS_INIT to SSH_SFTP_UPLOAD_INIT
* SFTP 0x99a3af8 state change from SSH_SFTP_UPLOAD_INIT to SSH_STOP
* DO phase is complete
} [data not shown]
% Total % Received % Xferd Average Speed Time Time Time Current

Dload Upload Total Spent Left Speed

0 3975k 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0* SSH DISCONNECT starts now
* SFTP 0x99a3af8 state change from SSH_STOP to SSH_SFTP_SHUTDOWN
* SFTP 0x99a3af8 state change from SSH_SFTP_SHUTDOWN to SSH_SESSION_DISCONNECT
* SFTP 0x99a3af8 state change from SSH_SESSION_DISCONNECT to SSH_SESSION_FREE
* SFTP 0x99a3af8 state change from SSH_SESSION_FREE to SSH_STOP
* SSH DISCONNECT is done

* Closing connection #0
* Failed sending data to the peer

curl: (55) Failed sending data to the peer

Jade Rubick
Director of Development
Truist
120 Wall Street, 4th Floor
New York, NY 10005 USA
jade <at> volunteersolutions.org
+1 503 285 4963
+1 707 671 1333 fax

www.truist.com

The information contained in this email/document is confidential and may be legally privileged. Access to this email/document by anyone other than the intended recipient(s) is unauthorized. If you are not an intended recipient, any disclosure, copying, distribution, or any action taken or omitted to be taken in reliance to it, is prohibited.

On Aug 29, 2008, at 6:48 AM, Daniel Stenberg wrote:

On Thu, 28 Aug 2008, Jade Rubick wrote:

I recently upgrade curl to 7.18.2 (compiled on FC4 linux 2.6.17-1.2142_FC4smp) in order to take advantage of the ability to connect via Sftp. I compiled it against libssh2-0.18.

I have been able to download files correctly, and do directory listings, but when I upload files, files that are more than tiny are corrupted and I get an error instead of successful completion.

Any suggestions?

It looks like a bug.

Current
Dload Upload Total Spent Left Speed
0 3975k 0 0 0 0 0 0 --:--:-- 0:00:04 --:--:-- 0* Closing connection #0
* Failed sending data to the peer

curl: (55) Failed sending data to the peer

It seems to fail immediately when it wants to send data. It's really hard to tell why based only on this output. I suggest you rebuilt both curl and libssh2 with configure --enable-debug and see if that gives any further hints in the debug output.

--

/ daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ: http://curl.haxx.se/docs/faq.html
Etiquette: http://curl.haxx.se/mail/etiquette.html

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

lakk_esbjrn | 2 Sep 2008 20:29

Re: Post in a forum

Now that I can post a reply on a phpbb forum, I'm sorry to come back to
you because I have another difficulties to post in an other kind of
forum, this is the forum of which I speak in the first mail, here is the
form :

<textarea class="userform" name="message" rows="12" cols="80"></textarea>

						</td>
					</tr>
										<tr>
						<td class="default">
							&nbsp;
						</td>
						<td class="default">
							<input class="userform" value="Poster ce message" name="valid" accesskey="S"
type="submit"> <input class="userform" value="Prévisualiser ce message" name="preview"
accesskey="P" type="submit">

						</td>
					</tr>
					<tr>
						<td class="default_big" style="border-bottom: 1px dotted rgb(170, 170, 170);">
							Options du message
						</td>
						<td class="default_big" style="border-bottom: 1px dotted rgb(170, 170, 170);">
														<input name="activatesignature" class="userform" value="1" checked="checked"
type="checkbox"> Insérer votre signature<br>
														<input name="disablesmilies" class="userform" value="1" type="checkbox">
Désactiver les smilies<br>

I use the same way to login to this page
http://nameforum.com/index.php?page=identify&forum=nameforum, which
source is

<td class="mainbox"> 
						<form action="./index.php?page=identify&amp;forum=nameforum&amp;option=identify" method="post">
							<table style="width: 90%; margin-left: auto; margin-right: auto;">
								<tbody><tr>
									<td colspan="2">
										<div class="titresection">Informations personnelles</div>
									</td>
								</tr>

								<tr>
									<td>Pseudo</td>
									<td><input name="nick" size="20" type="text"></td>
								</tr>
								<tr>
									<td>Mot de passe</td>
									<td><input name="password" size="20" type="password"></td>
								</tr>

							</tbody></table>
							<table style="width: 100%;">
								<tbody><tr>
									<td style="width: 50%; text-align: center;"><input value="Annuler"
onclick="window.location='./index.php?forum=nameforum" type="button"></td>
									<td style="width: 50%; text-align: center;"><input value="Valider" type="submit"></td>
								</tr>
							</tbody></table>
							<div class="center"><a
href="./index.php?page=identify&amp;forum=nameforum&amp;option=forgotpass">J'ai oublié mon
mot de passe</a></div>
						</form>

					</td>
				</tr>
			</tbody>

I use the command :

 curl -A "Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.9.0.1)
Gecko/2008070400 SUSE/3.0.1-7.1 Firefox/3.0.1" -e
"http://forum.nameforum.com/nameforum" -d
"nick=username&password=password&submit=Valider" -c "CookieMH.txt"
"http://forum.nameforum.com/index.php?page=identify&forum=nameforum" >
coucouMH.html

I'm not authentified because I think one cookie is missing. The only
which is kepted is named "sessionforum", but I'm sure one other is
needed, and is named keyforum => If I add this cookie in the file
CookieMH.txt, I see in the response that I try to post directly "you're
using nickname xxx" which is the correct one.

So my first problem is how to keep all necessary cookies in this login
page ? here is the liveHTTP log :

http://forumnameforum.com/index.php?page=identify&forum=nameforumoption=identify
POST /index.php?page=identify&forum=nameforum&option=identify HTTP/1.1
Host: forum.nameforum.com
User-Agent: Mozilla/5.0 (X11; U; Linux i686; fr; rv:1.9.0.1)
Gecko/2008070400 SUSE/3.0.1-7.1 Firefox/3.0.1
Accept: text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
Accept-Language: fr,fr-fr;q=0.8,en-us;q=0.5,en;q=0.3
Accept-Encoding: gzip,deflate
Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.7
Keep-Alive: 300
Connection: keep-alive
Referer: http://forum.nameforum.com/index.php?page=identify&forum=nameforum2
Cookie:
__utmz=267689497.1220107118.416.24.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=argument.txt;
Apxxx=1; keytforum=3jnEVeaXDFtmnspk3eg4XXPp442aY3DR;
__utma=213901525.86146944302048160.1213438880.1213726837.1220171532.3;
__utmz=213901525.1220171532.3.2.utmcsr=google|utmccn=(organic)|utmcmd=organic|utmctr=flaskmpeg;
pseudo=jxxx;
__utma=267689497.3761709358129836500.1212511832.1220132230.1220167247.419;
sessionforum=bf71f97230195b0abd9ed2ca9a49be37;
__utmb=267689497.168.10.1220167247; __utmc=267689497; __utmc=213901525
Content-Type: application/x-www-form-urlencoded
Content-Length: 42
nick=xxx&password=xxx
HTTP/1.x 200 OK
Date: Sun, 31 Aug 2008 12:00:33 GMT
Server: Apache/2.2.8 (Unix) PHP/5.2.5
X-Powered-By: PHP/5.2.5
Expires: Thu, 19 Nov 1981 08:52:00 GMT
Cache-Control: no-cache, must-revalidate, post-check=0, pre-check=0
Pragma: no-cache
X-Software: X2board-2.2
Set-Cookie: keyforum=3jnEVeaXDFtmnspk3eg4XXPp442aY3DR; expires=Mon,
31-Aug-2009 12:00:33 GMT; path=/
Set-Cookie: utilisateur=3jnEVeaXDFtmnspk3eg4XXPp442aY3DR; expires=Mon,
31-Aug-2009 12:00:33 GMT; path=/; domain=.xxx
Vary: Accept-Encoding,User-Agent
Content-Encoding: gzip
Content-Length: 4873
Keep-Alive: timeout=1, max=1000
Connection: Keep-Alive
Content-Type: text/html

If you could suggest me another way, thanks again

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

Markus Moeller | 2 Sep 2008 22:08

curl crash when using sftp with socks

Hi,

I try to use curl with sftp through a socks proxy as follows

curl --socks5 socks-server -u user -v sftp://shell.sf.net

but it crashes because the sftp_handle is 0.

(gdb) where
#0  libssh2_sftp_write (handle=0x0, buffer=0xbfa5ea00 "\005\001", count=3) 
at sftp.c:1330
#1  0xb7ee0761 in Curl_sftp_send (conn=0x80773f0, sockindex=0, 
mem=0xbfa5ea00, len=3) at ssh.c:2379
#2  0xb7eba4e6 in Curl_write (conn=0x80773f0, sockfd=8, mem=0xbfa5ea00, 
len=3, written=0xbfa5eca4) at sendf.c:365
#3  0xb7edaf14 in Curl_SOCKS5 (proxy_name=0x0, proxy_password=0x0, 
hostname=0x8077898 "shell.sf.net", remote_port=22, sockindex=0, 
conn=0x80773f0) at socks.c:435
#4  0xb7ec328d in Curl_connect (data=0x806b540, in_connect=0xbfa5ed70, 
asyncp=0xbfa5ed77, protocol_done=0xbfa5ed76) at url.c:2662
#5  0xb7ecfbaa in Curl_perform (data=0x806b540) at transfer.c:2291
#6  0xb7ed080d in curl_easy_perform (curl=0x806b540) at easy.c:520
#7  0x0804f803 in main (argc=Cannot access memory at address 0x3
) at main.c:4692

I use:

/opt/curl/bin/curl -V
curl 7.18.2 (i686-pc-linux-gnu) libcurl/7.18.2 OpenSSL/0.9.8a zlib/1.2.3 
libssh2/0.18
Protocols: tftp ftp telnet dict ldap http file https ftps scp sftp 
Features: IPv6 Largefile NTLM SSL libz 

Is this a known problem and does a fix exist already ?

Thank you
Markus

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

Daniel Stenberg | 2 Sep 2008 22:46

Re: curl crash when using sftp with socks

On Tue, 2 Sep 2008, Markus Moeller wrote:

> curl --socks5 socks-server -u user -v sftp://shell.sf.net
>
> but it crashes because the sftp_handle is 0.

...

> Is this a known problem and does a fix exist already ?

Yes and yes. The cure is called version 7.19.0! 
-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

headers

Markus Moeller | 3 Sep 2008 01:06

Is there a curl windows binary with sftp/libssh support available ?

If so where can I find it ?

Thank you 
Markus

-------------------------------------------------------------------
List admin: http://cool.haxx.se/cgi-bin/mailman/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

19	May 2013
36	April 2013
44	March 2013
39	February 2013
27	January 2013
18	December 2012
47	November 2012
41	October 2012
37	September 2012
40	August 2012
30	July 2012
78	June 2012
122	May 2012
101	April 2012
69	March 2012
43	February 2012
72	January 2012
51	December 2011
50	November 2011
36	October 2011
43	September 2011
89	August 2011
51	July 2011
62	June 2011
55	May 2011
84	April 2011
78	March 2011
55	February 2011
98	January 2011
43	December 2010
66	November 2010
90	October 2010
65	September 2010
73	August 2010
67	July 2010
46	June 2010
89	May 2010
112	April 2010
83	March 2010
58	February 2010
38	January 2010
59	December 2009
104	November 2009
42	October 2009
67	September 2009
76	August 2009
91	July 2009
79	June 2009
75	May 2009
122	April 2009
121	March 2009
134	February 2009
157	January 2009
96	December 2008
84	November 2008
88	October 2008
110	September 2008
167	August 2008
183	July 2008
113	June 2008
124	May 2008
141	April 2008
105	March 2008
86	February 2008
98	January 2008
107	December 2007
127	November 2007
155	October 2007
92	September 2007
113	August 2007
63	July 2007
129	June 2007
101	May 2007
108	April 2007
132	March 2007
148	February 2007
171	January 2007
86	December 2006
154	November 2006
141	October 2006
165	September 2006
78	August 2006
87	July 2006
83	June 2006
84	May 2006
77	April 2006
91	March 2006
105	February 2006
132	January 2006
102	December 2005
152	November 2005
138	October 2005
123	September 2005
169	August 2005
95	July 2005
145	June 2005
107	May 2005
153	April 2005
153	March 2005
168	February 2005
175	January 2005
130	December 2004
172	November 2004
105	October 2004
108	September 2004
80	August 2004
132	July 2004
78	June 2004
139	May 2004
73	April 2004
147	March 2004
101	February 2004
101	January 2004
110	December 2003
139	November 2003
205	October 2003
122	September 2003
169	August 2003
207	July 2003
133	June 2003
181	May 2003
231	April 2003
139	March 2003
145	February 2003
171	January 2003
124	December 2002
123	November 2002
202	October 2002
81	September 2002
108	August 2002
76	July 2002

Mon	Tue	Wed	Thu	Fri	Sat	Sun

1	2	3	4	5	6	7
8	9	10	11	12	13	14
15	16	17	18	19	20	21
22	23	24	25	26	27	28
29	30