Wayne | 6 Apr 2011 03:45
Picon

Ubuntu Install

I'm trying to install the library on an Ubuntu Server (10.10) running
Postgresql 9.0. When I run "sudo madpack install" I get this error:

Traceback (most recent call last):
  File "/usr/local/bin/madpack", line 248, in <module>
    main(sys.argv[1:])
  File "/usr/local/bin/madpack", line 221, in main
    prep(args.scriptdir[0], args.configdir[0])
  File "/usr/local/bin/madpack", line 42, in prep
    mig = __get_mig(conf_dir,targetdir)
  File "/usr/local/bin/madpack", line 22, in __get_mig
    return madpy.madpack.migrations.MadPackMigration(mig_dir,
conf_dir)
  File "/usr/local/lib/python2.6/dist-packages/madpy/madpack/
migrations.py", line 117, in __init__
    self.dbconn = dbapi2.connect( **con_args)
  File "build/bdist.linux-x86_64/egg/pgdb.py", line 482, in connect
pg.InternalError: fe_sendauth: no password supplied

Exception AttributeError: "MadPackMigration instance has no attribute
'dbconn'" in <bound method MadPackMigration.__del__ of
<madpy.madpack.migrations.MadPackMigration instance at 0x1a0d950>>
ignored

I have my password included in Config.yml but this message continues
to show up.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
(Continue reading)

Aleks | 6 Apr 2011 19:14

Re: Ubuntu Install

Wayne, could you try "madpack install" w/o sudo?


What's your Config.yml look like?

--
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.
Wayne Choi | 6 Apr 2011 20:24
Picon

Re: Re: Ubuntu Install

It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error but it's trying to add/modify something in the /etc/ directory.

I haven't modified anything in the config except for my login credentials. I can access the data from the python command line with these credentials using psyco2

On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gorajek-mb1K0bWo544@public.gmane.org> wrote:
> Wayne, could you try "madpack install" w/o sudo?
>
> What's your Config.yml look like?
>
> --
> You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> To post to this group, send email to madlib-user-forum-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org.
> To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
> For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.
>

--
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.
Joe Hellerstein | 6 Apr 2011 20:28
Picon
Favicon
Gravatar

Re: Re: Ubuntu Install

Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.

When you're back at the keyboard, send the Config.yml along.

Joe

On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:

> It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error but
it's trying to add/modify something in the /etc/ directory.
> 
> I haven't modified anything in the config except for my login credentials. I can access the data from the
python command line with these credentials using psyco2
> 
> On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gorajek@...> wrote:
> > Wayne, could you try "madpack install" w/o sudo?
> > 
> > What's your Config.yml look like?
> > 
> > -- 
> > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > To post to this group, send email to madlib-user-forum@...
> > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.
> > 
> 
> -- 
> You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> To post to this group, send email to madlib-user-forum@...
> To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

buddha_314 | 6 Apr 2011 20:39
Picon

Re: Ubuntu Install

This does look like the password is not in the Config.yml file.  But
I've also seen many errors with the script trying to use pygresql and
psycopg2.  Please check the driver library and make sure you have it
installed on your system.

On Apr 6, 11:28 am, Joe Hellerstein <hellerst...@...>
wrote:
> Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.
>
> When you're back at the keyboard, send the Config.yml along.
>
> Joe
>
> On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:
>
>
>
>
>
>
>
> > It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error but
it's trying to add/modify something in the /etc/ directory.
>
> > I haven't modified anything in the config except for my login credentials. I can access the data from the
python command line with these credentials using psyco2
>
> > On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gora...@...> wrote:
> > > Wayne, could you try "madpack install" w/o sudo?
>
> > > What's your Config.yml look like?
>
> > > --
> > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.
>
> > --
> > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > To post to this group, send email to madlib-user-forum@....
> > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

Wayne | 6 Apr 2011 21:59
Picon

Re: Ubuntu Install

Ok...here's my Config.yml. I am able to connect to the database with
these settings from the Python Interpreter.

#
# REQUIRED PARAMETERS:
#

# Name DB connection module for your platform
# Must be compliant with DB API 2.0.
# Tested: pygresql.pgdb, psycopg2
dbapi2: psycopg2

# According to DB API 2.0 specification
# allowed connection arguments:
#   dsn         Data source name as string
#   user        User name as string (optional)
#   password    Password as string (optional)
#   host        Hostname (optional)
#   database    Database name (optional)
connect_args:
    - host=localhost
    - database=wchoi
    - user=wchoi
    - password=w4yn3
# Name of your database schema to store MADlib objects
target_schema: madlib

# List of MADlib methods
methods:
    - name: sketch
      port: pg_gp

    - name: profile
      port: pg_gp

    - name: bayes
      port: pg_gp

    - name: k-means
      port: pg_gp

    - name: kernel-machines
      port: pg_gp

    - name: regress
      port: pg_gp

    - name: svec
      port: pg_gp

    - name: svd-mf
      port: pg_gp

    - name: quantile
      port: pg_gp

    - name: decision-tree
      port: pg_gp

    - name: conjugate-gradient
      port: pg_gp

#
# OPTIONAL PARAMETERS:
#

# Preprocessor macros for use in SQL files.
# For Conditional inclusion of lines, e.g.
# depending on whether you're targeting Postgres or Greenplum.
# prep_flags: -DGREENPLUM

# Extension hook for post install actions.
# Name of a python script to run after standard installation.
# post_hook: greenplum.py

When I try to run madpack install without sudo, I get this:

*** Installing MADlib: database=wchoi, schema=madlib ***

Processing methods: clean_data_built
cannot create /usr/local/lib/python2.6/dist-packages/madlib/sketch/src/
pg_gp/config.mk

When I run it sudo madpack install, I  get the follow:

*** Installing MADlib: database=wchoi, schema=madlib ***

Processing methods: clean_data_built
- sketch
- bayes
- regression
- svec
- svd-mf
- quantile
- conjugate-gradient
- profile
- k-means
- kernel-machines
- decision-tree
Processing methods: install
- sketch
- bayes
- regression
- svec
- svd-mf
- quantile
- conjugate-gradient
- profile
- k-means
- kernel-machines
- decision-tree
Traceback (most recent call last):
  File "/usr/local/bin/madpack", line 248, in <module>
    main(sys.argv[1:])
  File "/usr/local/bin/madpack", line 221, in main
    prep(args.scriptdir[0], args.configdir[0])
  File "/usr/local/bin/madpack", line 42, in prep
    mig = __get_mig(conf_dir,targetdir)
  File "/usr/local/bin/madpack", line 22, in __get_mig
    return madpy.madpack.migrations.MadPackMigration(mig_dir,
conf_dir)
  File "/usr/local/lib/python2.6/dist-packages/madpy/madpack/
migrations.py", line 117, in __init__
    self.dbconn = dbapi2.connect( **con_args)
  File "build/bdist.linux-x86_64/egg/pgdb.py", line 482, in connect
pg.InternalError: fe_sendauth: no password supplied

Exception AttributeError: "MadPackMigration instance has no attribute
'dbconn'" in <bound method MadPackMigration.__del__ of
<madpy.madpack.migrations.MadPackMigration instance at 0x1387830>>
ignored

On Apr 6, 11:39 am, buddha_314 <buddha...@...> wrote:
> This does look like the password is not in the Config.yml file.  But
> I've also seen many errors with the script trying to use pygresql and
> psycopg2.  Please check the driver library and make sure you have it
> installed on your system.
>
> On Apr 6, 11:28 am, Joe Hellerstein <hellerst...@...>
> wrote:
>
>
>
>
>
>
>
> > Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.
>
> > When you're back at the keyboard, send the Config.yml along.
>
> > Joe
>
> > On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:
>
> > > It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error but
it's trying to add/modify something in the /etc/ directory.
>
> > > I haven't modified anything in the config except for my login credentials. I can access the data from the
python command line with these credentials using psyco2
>
> > > On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gora...@...> wrote:
> > > > Wayne, could you try "madpack install" w/o sudo?
>
> > > > What's your Config.yml look like?
>
> > > > --
> > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.
>
> > > --
> > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

Wayne | 6 Apr 2011 22:05
Picon

Re: Ubuntu Install

I should also point out that I can't run python setup.py install
without sudo. When I run it without sudo I get this:

wchoi <at> wchoi-Rev-1-0:~/source-code/madlib$ python setup.py install
running install
running build
running build_py
package init file 'methods/__init__.py' not found (or not a regular
file)
package init file 'madpy/config/__init__.py' not found (or not a
regular file)
package init file 'methods/__init__.py' not found (or not a regular
file)
package init file 'madpy/config/__init__.py' not found (or not a
regular file)
running build_scripts
running install_lib
running install_scripts
changing mode of /usr/local/bin/madpack to 755
error: /usr/local/bin/madpack: Operation not permitted

On Apr 6, 11:39 am, buddha_314 <buddha...@...> wrote:
> This does look like the password is not in the Config.yml file.  But
> I've also seen many errors with the script trying to use pygresql and
> psycopg2.  Please check the driver library and make sure you have it
> installed on your system.
>
> On Apr 6, 11:28 am, Joe Hellerstein <hellerst...@...>
> wrote:
>
>
>
>
>
>
>
> > Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.
>
> > When you're back at the keyboard, send the Config.yml along.
>
> > Joe
>
> > On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:
>
> > > It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error but
it's trying to add/modify something in the /etc/ directory.
>
> > > I haven't modified anything in the config except for my login credentials. I can access the data from the
python command line with these credentials using psyco2
>
> > > On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gora...@...> wrote:
> > > > Wayne, could you try "madpack install" w/o sudo?
>
> > > > What's your Config.yml look like?
>
> > > > --
> > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.
>
> > > --
> > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

buddha_314 | 6 Apr 2011 23:58
Picon

Re: Ubuntu Install

My guess would still be the psycopg2 library.  Try it with pygresql.
I had weird problem installing with it and it may be that the yml
parser isn't identifying correctly  when using psycopg2.

On Apr 6, 1:05 pm, Wayne <waynec...@...> wrote:
> I should also point out that I can't run python setup.py install
> without sudo. When I run it without sudo I get this:
>
> wchoi <at> wchoi-Rev-1-0:~/source-code/madlib$ python setup.py install
> running install
> running build
> running build_py
> package init file 'methods/__init__.py' not found (or not a regular
> file)
> package init file 'madpy/config/__init__.py' not found (or not a
> regular file)
> package init file 'methods/__init__.py' not found (or not a regular
> file)
> package init file 'madpy/config/__init__.py' not found (or not a
> regular file)
> running build_scripts
> running install_lib
> running install_scripts
> changing mode of /usr/local/bin/madpack to 755
> error: /usr/local/bin/madpack: Operation not permitted
>
> On Apr 6, 11:39 am, buddha_314 <buddha...@...> wrote:
>
>
>
>
>
>
>
> > This does look like the password is not in the Config.yml file.  But
> > I've also seen many errors with the script trying to use pygresql and
> > psycopg2.  Please check the driver library and make sure you have it
> > installed on your system.
>
> > On Apr 6, 11:28 am, Joe Hellerstein <hellerst...@...>
> > wrote:
>
> > > Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.
>
> > > When you're back at the keyboard, send the Config.yml along.
>
> > > Joe
>
> > > On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:
>
> > > > It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error
but it's trying to add/modify something in the /etc/ directory.
>
> > > > I haven't modified anything in the config except for my login credentials. I can access the data from
the python command line with these credentials using psyco2
>
> > > > On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gora...@...> wrote:
> > > > > Wayne, could you try "madpack install" w/o sudo?
>
> > > > > What's your Config.yml look like?
>
> > > > > --
> > > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.
>
> > > > --
> > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

buddha_314 | 7 Apr 2011 00:00
Picon

Re: Ubuntu Install

Wait, I just noticed this part in the error

migrations.py", line 117, in __init__
    self.dbconn = dbapi2.connect( **con_args)

Looks like it's trying to use dbapi2 anyway. Should it be?

On Apr 6, 2:58 pm, buddha_314 <buddha...@...> wrote:
> My guess would still be the psycopg2 library.  Try it with pygresql.
> I had weird problem installing with it and it may be that the yml
> parser isn't identifying correctly  when using psycopg2.
>
> On Apr 6, 1:05 pm, Wayne <waynec...@...> wrote:
>
>
>
>
>
>
>
> > I should also point out that I can't run python setup.py install
> > without sudo. When I run it without sudo I get this:
>
> > wchoi <at> wchoi-Rev-1-0:~/source-code/madlib$ python setup.py install
> > running install
> > running build
> > running build_py
> > package init file 'methods/__init__.py' not found (or not a regular
> > file)
> > package init file 'madpy/config/__init__.py' not found (or not a
> > regular file)
> > package init file 'methods/__init__.py' not found (or not a regular
> > file)
> > package init file 'madpy/config/__init__.py' not found (or not a
> > regular file)
> > running build_scripts
> > running install_lib
> > running install_scripts
> > changing mode of /usr/local/bin/madpack to 755
> > error: /usr/local/bin/madpack: Operation not permitted
>
> > On Apr 6, 11:39 am, buddha_314 <buddha...@...> wrote:
>
> > > This does look like the password is not in the Config.yml file.  But
> > > I've also seen many errors with the script trying to use pygresql and
> > > psycopg2.  Please check the driver library and make sure you have it
> > > installed on your system.
>
> > > On Apr 6, 11:28 am, Joe Hellerstein <hellerst...@...>
> > > wrote:
>
> > > > Hi Wayne, it's tough to debug without seeing your Config.yml, but it looks like you're having trouble
connecting to the database -- i.e. could be a credentials issue.
>
> > > > When you're back at the keyboard, send the Config.yml along.
>
> > > > Joe
>
> > > > On Apr 6, 2011, at 11:24 AM, Wayne Choi wrote:
>
> > > > > It won't run without sudo. I'm not in front of my computer right now so I don't remember the exact error
but it's trying to add/modify something in the /etc/ directory.
>
> > > > > I haven't modified anything in the config except for my login credentials. I can access the data from
the python command line with these credentials using psyco2
>
> > > > > On Apr 6, 2011 10:14 AM, "Aleks" <Aleksander.Gora...@...> wrote:
> > > > > > Wayne, could you try "madpack install" w/o sudo?
>
> > > > > > What's your Config.yml look like?
>
> > > > > > --
> > > > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.
>
> > > > > --
> > > > > You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
> > > > > To post to this group, send email to madlib-user-forum <at> googlegroups.com.
> > > > > To unsubscribe from this group, send email to madlib-user-forum+unsubscribe@...
> > > > > For more options, visit this group athttp://groups.google.com/group/madlib-user-forum?hl=en.

--

-- 
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum@...
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe <at> googlegroups.com.
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

Aleks | 7 Apr 2011 00:02

Re: Ubuntu Install

Wayne, is there any chance you can try a different dbapi2 module (like pygresql.pgdb for example)?


--
You received this message because you are subscribed to the Google Groups "MADlib User Forum" group.
To post to this group, send email to madlib-user-forum-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
To unsubscribe from this group, send email to madlib-user-forum+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit this group at http://groups.google.com/group/madlib-user-forum?hl=en.

Gmane