Manjushri | 1 Jul 10:42 2010
Picon

Proxy CONNECT aborted

I am facing some issues while using php curl library. I am setting 
following parameters,

          curl_setopt($c, CURLOPT_HTTPPROXYTUNNEL,1);
          curl_setopt($c, CURLOPT_PROXY, 'http://localhost:8080');
          curl_setopt($c, CURLOPT_PROXYPORT, '8080');
          curl_setopt($c, CURLOPT_PROXYAUTH, CURLAUTH_BASIC);
          curl_setopt($c, CURLOPT_HEADER, 1);
          curl_setopt($c, CURLOPT_TIMEOUT, 5);
          curl_setopt($c, CURLOPT_URL, 'https://xyz:4443/asd/asw' );
          #curl_setopt($c, CURLOPT_POST, 1);
          curl_setopt($c, CURLOPT_POSTFIELDS,  $XML_REQUEST);
          curl_setopt($c, CURLOPT_HTTPHEADER, $header);
          curl_setopt($c, CURLOPT_SSL_VERIFYPEER, 0);
          curl_setopt($c, CURLOPT_SSL_VERIFYHOST, 0);
          #curl_setopt($c, CURLOPT_RETURNTRANSFER, 1);

I am getting following exception from curl
'Connection issue - 56 : Proxy CONNECT aborted

Please give me some pointers to resolve this.

Thanks,
Manjushri
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

(Continue reading)

Mike Hutchinson | 1 Jul 16:02 2010

Michael Hutchinson/UK/RoyalSun is out of the office.

I will be out of the office starting  30/06/2010 and will not return until
05/07/2010.

For urgent queries regarding Web Quote Followup output please Email or
contact Richard Z Mason or Ian C Dawson in Data Services and cc me in.
Otherwise I will respond to your message when I return.

______________________________________________________________________

**********************************************************************

MORE TH>N ® is a trading style of Royal & Sun Alliance

Insurance plc (No. 93792). Registered in England and Wales at

St. Mark's Court, Chart Way, Horsham, West Sussex RH12 1XL.

Authorised & regulated by the Financial Services Authority

For your protection, telephone calls will be recorded and may be

monitored.

The information in this e-mail is confidential and may be read, copied

or used only by the intended recipients. If you have received it in

error please contact the sender immediately by returning the e-mail or

by telephoning the number contained in the body of the e-mail and
(Continue reading)

Daniel Stenberg | 1 Jul 23:44 2010
Picon

Re: Proxy CONNECT aborted

On Thu, 1 Jul 2010, Manjushri wrote:

> I am facing some issues while using php curl library. I am setting following 
> parameters,

I recommend the curl-and-php mailing list for PHP/CURL users. This mailing 
list is primarily for users of the command line tool curl.

> I am getting following exception from curl
> 'Connection issue - 56 : Proxy CONNECT aborted

That sounds like an unexpected disconnect/end of response when libcurl sent a 
CONNECT request. You should investigate the response headers and see what they 
reveal.

And you forgot to mention lots of details such as libcurl version and 
operating system etc.

--

-- 

  / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

Daniel Stenberg | 2 Jul 22:05 2010
Picon

a dedicated list for web scraping issues

Hi

[sorry for being slightly off-topic, but let's not do any follow-ups on this 
mail on this list]

As I know lots of people using curl are interested in and working on web 
scraping in various degrees and manners, I would just like to mention that 
we've just today setup a brand new mailing list for the sole purpose of 
discussing screen scraping, web bots, internet spidering, http scripting and 
related matters.

All details can be found at http://webscrapers.haxx.se/

--

-- 

  / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

Karolis Linkevicius | 8 Jul 13:08 2010
Picon

cURL form submition

Hi, I have I problem submitting a form. The page code is this:

<html>

    <head>

        <title>

            S4ID IS

        </title>

        <meta http-equiv=Content-Type content="text/html; charset=UTF-8" />

        <link rel="stylesheet" type="text/css" href="http://www.s4idis.lt//system/application/views/css/login.css" />

    </head>

    <body>

                <form action="http://www.s4idis.lt/index.php/login/validate" method="post">

        <div id="loginWin">

        <h1>S4ID IS</h1>

 

        <h5>Vartotojo vardas</h5>

        <input type="text" name="username" value="xxxx" size="50" />

 

        <h5>Slaptažodis</h5>

        <input type="password" name="password" value="xxxx" size="50" />

 

        <div id="butt"><input type="submit" name="press" value="Tvirtinti" /></div>

        </div>

        </form>

 

    </body>

</html>

 

The curl command that have used: curl  -d "username=XXXX&password=XXXX&press=Tvirtinti" -L www.s4idis.lt

After this command I get only the upper html code and I’m not being redirected to home page. The POST data is correct (I have checked it with firefox web sniffer).

When using web browser and submitting that form I see that there are two data transfers being made: POST and GET.

 

POST:

 

Response Headersview source

Date

Thu, 08 Jul 2010 11:01:57 GMT

Server

Apache/2.2.3 (CentOS)

X-Powered-By

PHP/5.2.13

Set-Cookie

ci_session=a%3A4%3A%7Bs%3A10%3A%22session_id%22%3Bs%3A32%3A%22297060724a88f587021df582d762a7ca%22%3Bs%3A10%3A%22ip_address%22%3Bs%3A12%3A%2286.38.35.105%22%3Bs%3A10%3A%22user_agent%22%3Bs%3A50%3A%22Mozilla%2F5.0+%28Windows%3B+U%3B+Windows+NT+6.1%3B+en-GB%3B+rv%22%3Bs%3A13%3A%22last_activity%22%3Bs%3A10%3A%221278586917%22%3B%7Db716829200944486b116af20eeee9c39; expires=Thu, 08-Jul-2010 13:01:57 GMT; path=/ ci_session=a%3A6%3A%7Bs%3A10%3A%22session_id%22%3Bs%3A32%3A%22297060724a88f587021df582d762a7ca%22%3Bs%3A10%3A%22ip_address%22%3Bs%3A12%3A%2286.38.35.105%22%3Bs%3A10%3A%22user_agent%22%3Bs%3A50%3A%22Mozilla%2F5.0+%28Windows%3B+U%3B+Windows+NT+6.1%3B+en-GB%3B+rv%22%3Bs%3A13%3A%22last_activity%22%3Bs%3A10%3A%221278586917%22%3Bs%3A8%3A%22username%22%3Bs%3A7%3A%22karolis%22%3Bs%3A12%3A%22is_logged_in%22%3Bs%3A1%3A%221%22%3B%7Ded386356a9f5427112c720c9a413f4c8; expires=Thu, 08-Jul-2010 13:01:57 GMT; path=/

Location

http://www.s4idis.lt/index.php/mainc/menu

Content-Length

0

Connection

close

Content-Type

text/html

Request Headersview source

Host

www.s4idis.lt

User-Agent

Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6

Accept

text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8

Accept-Language

en-gb,en;q=0.5

Accept-Encoding

gzip,deflate

Accept-Charset

ISO-8859-1,utf-8;q=0.7,*;q=0.7

Keep-Alive

115

Connection

keep-alive

Referer

http://www.s4idis.lt/index.php/login/logout

 

GET:

 

Response Headersview source

Date

Thu, 08 Jul 2010 11:01:57 GMT

Server

Apache/2.2.3 (CentOS)

X-Powered-By

PHP/5.2.13

Connection

close

Transfer-Encoding

chunked

Content-Type

text/html

Request Headersview source

Host

www.s4idis.lt

User-Agent

Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.2.6) Gecko/20100625 Firefox/3.6.6

Accept

text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8

Accept-Language

en-gb,en;q=0.5

Accept-Encoding

gzip,deflate

Accept-Charset

ISO-8859-1,utf-8;q=0.7,*;q=0.7

Keep-Alive

115

Connection

keep-alive

Referer

http://www.s4idis.lt/index.php/login/logout

Cookie

ci_session=a%3A6%3A%7Bs%3A10%3A%22session_id%22%3Bs%3A32%3A%22297060724a88f587021df582d762a7ca%22%3Bs%3A10%3A%22ip_address%22%3Bs%3A12%3A%2286.38.35.105%22%3Bs%3A10%3A%22user_agent%22%3Bs%3A50%3A%22Mozilla%2F5.0+%28Windows%3B+U%3B+Windows+NT+6.1%3B+en-GB%3B+rv%22%3Bs%3A13%3A%22last_activity%22%3Bs%3A10%3A%221278586917%22%3Bs%3A8%3A%22username%22%3Bs%3A7%3A%22karolis%22%3Bs%3A12%3A%22is_logged_in%22%3Bs%3A1%3A%221%22%3B%7Ded386356a9f5427112c720c9a413f4c8

 

I’ve also tried to add Referer and user Agent data, but get the same html submit form filled with my POST data and not being redirected to home page. What should I do? Is it a problem with cURL or with the web page? The web page is created by me so I can easily change the code if needed. Please, help me!

 

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html
Doug McNutt | 8 Jul 20:24 2010

Re: a dedicated list for web scraping issues

At 22:05 +0200 7/2/10, Daniel Stenberg wrote:
>As I know lots of people using curl are interested in and working on web scraping in various degrees and
manners, I would just like to mention that we've just today setup a brand new mailing list for the sole
purpose of discussing screen scraping, web bots, internet spidering, http scripting and related matters.
>
>All details can be found at http://webscrapers.haxx.se/

Is anyone else having trouble with the subscription process. It could be the older browser I'm using this
older Macintosh that I use for mail but I'm being ignored. No email is being received for confirmation.

The archive page shows "2010 Jul" as an anchor but nothing gets returned.

Is there an old fashioned way to subscribe with an email?

--

-- 
--> Give me liberty or give me Obamacare <--
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

Daniel Stenberg | 8 Jul 22:00 2010
Picon

Re: a dedicated list for web scraping issues

On Thu, 8 Jul 2010, Doug McNutt wrote:

> Is anyone else having trouble with the subscription process.

I responded to Doug off-list on this. If anyone else has problems, please mail 
me privately and we'll work it out.

--

-- 

  / daniel.haxx.se
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

Rick Gross | 8 Jul 23:43 2010
Picon

cURL runs differently on different Windows systems

Trying to figure out why some Windows implementations will use http/1.1 when curl is run and some use 1.0.
When 1.0 is used truncated content is returned. I'm using the exact same command and same version of curl on
each system.

Any help would be much appreciated.

Thanks,
Rick
-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

autrelandes-curl | 9 Jul 22:39 2010
Picon

Problem with curl + nss

Hello,

I have some problems using curl + nss for FTP/S on Fedora.

Versions
========
$ uname -a
Linux SNNECCI 2.6.33.5-124.fc13.i686 #1 SMP Fri Jun 11 09:48:40 UTC 2010 i686 i686 i386 GNU/Linux

$ locate libnsspem.so
/usr/lib/libnsspem.so

$ curl -V
curl 7.20.1 (i386-redhat-linux-gnu) libcurl/7.20.1 NSS/3.12.6.2 zlib/1.2.3 libidn/1.16 libssh2/1.2.4
Protocols: dict file ftp ftps http https imap imaps ldap ldaps pop3 pop3s rtsp scp sftp smtp smtps telnet tftp
Features: AsynchDNS GSS-Negotiate IDN IPv6 Largefile SSL libz
$ rpm -q curl
curl-7.20.1-2.fc13.i686
$ rpm -q nss
nss-3.12.6-7.fc13.i686

== FTP/S Fedora curl + nss with PEM certificates created with openssl ==
$ curl --netrc --list-only --ftp-ssl-reqd \
       --cacert ~/PKILOCAL/cacert.pem \
       --cert ~/PKILOCAL/cert.pem:motdepasse --key ~/PKILOCAL/priv.key \
       ftp://localhost/
curl: (58) Unable to load client key -8178.
====

On the contrary, with an up-to-date curl from git compiled with openssl, the same command works :
== FTP/S curl from git + openssl with PEM certificates created with openssl ==
$ ./curl -V
curl 7.21.1-DEV (i686-pc-linux-gnu) libcurl/7.21.1-DEV OpenSSL/1.0.0 zlib/1.2.3
Protocols: file ftp ftps http https tftp
Features: IPv6 Largefile NTLM SSL libz
$ ./curl --netrc --list-only --ftp-ssl-reqd \
       --cacert ~/PKILOCAL/cacert.pem \
       --cert ~/PKILOCAL/cert.pem:motdepasse --key ~/PKILOCAL/priv.key \
       ftp://localhost/
file1
====

I also tried with SSL_DIR, with no success :
== FTP/S Fedora curl + nss with a nss database (imported from openssl PEM certs) ==
$ certutil -L -d ~/nssdblocal
Certificate Nickname          Trust Attributes
                              SSL,S/MIME,JAR/XPI
CERTLOCAL                     u,u,u
CALOCAL                       u,u,u
$ SSL_DIR=/home/eric/nssdblocal curl --netrc --list-only --ftp-ssl-reqd \
            --cacert "CALOCAL" \
            --cert "CERTLOCAL" \
            ftp://localhost/
curl: (77) Problem with the SSL CA cert (path? access rights?)
====

I tried with an up-to-date curl from git compiled with nss, with no success. 
Using certificates created directly with certutil (bundled with the nss-tools package) gave the same
results. 

Did I miss something ?

Eric

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html

autrelandes-curl | 9 Jul 23:00 2010
Picon

Re: Problem with curl + nss

--- En date de : Ven 9.7.10, Dan Fandrich <dan <at> coneharvesters.com> a écrit :
> Try running this with the -v option and post those results
> to the list.
Thanks for the reply. 

Here it is : 
$ curl -v --netrc --list-only --ftp-ssl-reqd \
        --cacert ~/PKILOCAL/cacert.pem \
        --cert ~/PKILOCAL/cert.pem:motdepasse --key ~/PKILOCAL/priv.key \
        ftp://localhost/
* About to connect() to localhost port 21 (#0)
*   Trying ::1... Connexion refusée
*   Trying 127.0.0.1... connected
* Connected to localhost (127.0.0.1) port 21 (#0)
< 220 (vsFTPd 2.2.2)
> AUTH SSL
< 234 Proceed with negotiation.
* Initializing NSS with certpath: /home/eric/nssdblocal
*   CAfile: /home/eric/PKILOCAL/cacert.pem
  CApath: none
* Unable to load client key -8178.
* Closing connection #0
curl: (58) Unable to load client key -8178.

And also an extract of what gives strace, before the failure : 
$ strace curl -v --netrc --list-only --ftp-ssl-reqd \
        --cacert ~/PKILOCAL/cacert.pem \
        --cert ~/PKILOCAL/cert.pem:motdepasse --key ~/PKILOCAL/priv.key \
        ftp://localhost/
[...]
open("/home/eric/PKILOCAL/cert.pem", O_RDONLY|O_LARGEFILE) = 7
fstat64(7, {st_mode=S_IFREG|0664, st_size=1436, ...}) = 0
read(7, "-----BEGIN CERTIFICATE-----\nMIID"..., 1436) = 1436
close(7)                                = 0
gettimeofday({1278708665, 99615}, NULL) = 0
gettimeofday({1278708665, 99907}, NULL) = 0
gettimeofday({1278708665, 100083}, NULL) = 0
gettimeofday({1278708665, 100485}, NULL) = 0
gettimeofday({1278708665, 100675}, NULL) = 0
gettimeofday({1278708665, 100898}, NULL) = 0
gettimeofday({1278708665, 101090}, NULL) = 0
gettimeofday({1278708665, 102865}, NULL) = 0
gettimeofday({1278708665, 103111}, NULL) = 0
gettimeofday({1278708665, 103320}, NULL) = 0
gettimeofday({1278708665, 103542}, NULL) = 0
gettimeofday({1278708665, 103795}, NULL) = 0
gettimeofday({1278708665, 104018}, NULL) = 0
gettimeofday({1278708665, 104235}, NULL) = 0
gettimeofday({1278708665, 104453}, NULL) = 0
gettimeofday({1278708665, 105161}, NULL) = 0
gettimeofday({1278708665, 105334}, NULL) = 0
open("/home/eric/PKILOCAL/priv.key", O_RDONLY|O_LARGEFILE) = 7
fstat64(7, {st_mode=S_IFREG|0664, st_size=1834, ...}) = 0
read(7, "-----BEGIN ENCRYPTED PRIVATE KEY"..., 1834) = 1834
close(7)                                = 0
write(2, "*", 1*)                        = 1
write(2, " ", 1 )                        = 1
write(2, "Unable to load client key -8178."..., 33Unable to load client key -8178.
[...]

http://www.mozilla.org/projects/security/pki/nss/ref/ssl/sslerr.htm says that -8178 is "Peer's
public key is invalid" (SEC_ERROR_BAD_KEY), but these certificate and key work with openssl. 

-------------------------------------------------------------------
List admin: http://cool.haxx.se/list/listinfo/curl-users
FAQ:        http://curl.haxx.se/docs/faq.html
Etiquette:  http://curl.haxx.se/mail/etiquette.html


Gmane