Andre Eliatamby | 2 Mar 2009 12:18
Picon

imdbpy and imdb licences/access terms

Hi,

I was just tinkering with imdbpy and looking through the source.  From
what I can gather, imdbpy functions as some sort of web scraper.  Now,
looking at the imdb terms and conditions, it seems the only
"interface" provided is ftp access to compressed text files.  In fact,
the terms and conditions explicitly forbid screen/web scrapers.

What I would like to know is:
 - are my assumptions above correct?
 - Does imdbpy have a special license from imdb to provide this package?
 - Do I need to get special permission for imdb to actually use this
package (or at least the query functions)?

Thanks,
Andre

------------------------------------------------------------------------------
Open Source Business Conference (OSBC), March 24-25, 2009, San Francisco, CA
-OSBC tackles the biggest issue in open source: Open Sourcing the Enterprise
-Strategies to boost innovation and cut costs with open source participation
-Receive a $600 discount off the registration fee with the source code: SFAD
http://p.sf.net/sfu/XcvMzF8H
Davide Alberani | 2 Mar 2009 19:53
Picon
Gravatar

Re: imdbpy and imdb licences/access terms

On Mar 02, Andre Eliatamby <andre.eliatamby@...> wrote:

> What I would like to know is:
>  - are my assumptions above correct?

Mostly; see also the other recent (and old) threads in imdbpy-devel.

>  - Does imdbpy have a special license from imdb to provide this package?

No.  I honestly can't even remember if I ever asked (maybe, maybe not:
I started the project in 2004).
For sure at some point (years ago) I questioned the developers of
other related libraries; many (most) never asked, some had tried.
The results can be summarized in:
- no reply at all.
- no, you can't: buy this (license for X thousands of data, missing
  the point of the request).
- yes you can (very few).

As far as I can remember there was a discussion about this kind of
software in debian-devel, and their opinion was that they are
ok for inclusion in Debian (it goes without saying that they
are more interested in the license of the code, so this may not
be conclusive).

The fact is (as usual: I'm not a lawyer) that similar terms
_as far as I know_ aren't clearly enforceable (I'm not sure
about the USA laws, however).
IMDbPY fetches the data the same way your browser (or your cache,
or your crap-filtering proxy) does.  After that, _for your own usage_
(Continue reading)

Davide Alberani | 12 Mar 2009 21:52
Picon
Gravatar

IMDbPY 4.0 and IMDbPYKit 1.0

Hi all,
I'm proud to announce that IMDbPY 4.0 is here! :-)

At the same time, you can download IMDbPYKit 1.0, the new web
interface of choice for IMDbPY.  Mostly developed by H. Turgut Uyar,
IMDbPYKit has a lot of nice feature (e.g.: it can output data in
both XML and HTML).

There are a lot of new feature in this IMDbPY release, like support
for keywords, support for top250/bottom100 lists and the ability
to export information in XML.  Many other minor features and a lot
of bug-fixes are included!

As usual, everything is available from here: http://imdbpy.sf.net/

Download && enjoy! :-)

--

-- 
Davide Alberani <davide.alberani@...> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
Jean-Yves Avenard | 13 Mar 2009 04:09
Picon
Gravatar

Re: IMDbPY 4.0 and IMDbPYKit 1.0

Hi

Doesn't build on any of my machines (Ubuntu 8.10 and CentOS 5.3) :(

adminext <at> hi-2-backend:~/IMDbPY-4.0$ sudo python setup.py build
running build
running build_py
running build_ext
building 'imdb.parser.common.cutils' extension
gcc -pthread -fno-strict-aliasing -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -fPIC -I/usr/include/python2.5 -c imdb/parser/common/cutils.c -o build/temp.linux-i686-2.5/imdb/parser/common/cutils.o
imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or directory
imdb/parser/common/cutils.c: In function ‘strings_check’:
imdb/parser/common/cutils.c:104: warning: implicit declaration of function ‘strlen’
imdb/parser/common/cutils.c:104: warning: incompatible implicit declaration of built-in function ‘strlen’
imdb/parser/common/cutils.c:112: warning: implicit declaration of function ‘strcmp’
imdb/parser/common/cutils.c: In function ‘ratcliff’:
imdb/parser/common/cutils.c:182: warning: incompatible implicit declaration of built-in function ‘strlen’
imdb/parser/common/cutils.c: In function ‘strtolower’:
imdb/parser/common/cutils.c:194: warning: incompatible implicit declaration of built-in function ‘strlen’
imdb/parser/common/cutils.c:194: warning: implicit declaration of function ‘tolower’
imdb/parser/common/cutils.c: At top level:
imdb/parser/common/cutils.c:199: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:233: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:365: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:556: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:627: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:721: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘*’ token
imdb/parser/common/cutils.c:768: error: expected ‘=’, ‘,’, ‘;’, ‘asm’ or ‘__attribute__’ before ‘cutils_methods’
imdb/parser/common/cutils.c: In function ‘initcutils’:
imdb/parser/common/cutils.c:788: warning: implicit declaration of function ‘Py_InitModule’
imdb/parser/common/cutils.c:788: error: ‘cutils_methods’ undeclared (first use in this function)
imdb/parser/common/cutils.c:788: error: (Each undeclared identifier is reported only once
imdb/parser/common/cutils.c:788: error: for each function it appears in.)

=======================


2009/3/13 Davide Alberani <davide.alberani-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Hi all,
I'm proud to announce that IMDbPY 4.0 is here! :-)

At the same time, you can download IMDbPYKit 1.0, the new web
interface of choice for IMDbPY.  Mostly developed by H. Turgut Uyar,
IMDbPYKit has a lot of nice feature (e.g.: it can output data in
both XML and HTML).

There are a lot of new feature in this IMDbPY release, like support
for keywords, support for top250/bottom100 lists and the ability
to export information in XML.  Many other minor features and a lot
of bug-fixes are included!

As usual, everything is available from here: http://imdbpy.sf.net/


Download && enjoy! :-)

--
Davide Alberani <davide.alberani-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel-5NWGOfrQmnc@public.gmane.orgurceforge.net
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@...
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
Jean-Yves Avenard | 13 Mar 2009 04:12
Picon
Gravatar

Re: IMDbPY 4.0 and IMDbPYKit 1.0

Hi

2009/3/13 Jean-Yves Avenard <jyavenard-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or directory
imdb/parser/common/cutils.c: In function ‘strings_check’:

Oops, forget my last message..

easily fixed...
 

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
_______________________________________________
Imdbpy-devel mailing list
Imdbpy-devel@...
https://lists.sourceforge.net/lists/listinfo/imdbpy-devel
Davide Alberani | 13 Mar 2009 08:42
Picon
Gravatar

Re: [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

On Mar 13, Jean-Yves Avenard <jyavenard@...> wrote:

> Doesn't build on any of my machines (Ubuntu 8.10 and CentOS 5.3) :(

The kind of things you don't want to hear 12 hours after
a release. ;-)

> imdb/parser/common/cutils.c:63:20: error: Python.h: No such file or
> directory

Looks like you're missing the python-dev package, used to compile
an (optional, but suggested) C module.

Let me know if it solves the problem.

As an extreme measure, you can add the "--without-cutils" command
line argument to exclude the cutils.c module, but...

Bye,
--

-- 
Davide Alberani <davide.alberani@...> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
Davide Alberani | 13 Mar 2009 08:44
Picon
Gravatar

Re: [Imdbpy-devel] IMDbPY 4.0 and IMDbPYKit 1.0

On Mar 13, Jean-Yves Avenard <jyavenard@...> wrote:

> Oops, forget my last message..
> 
> easily fixed...

Glad to hear it. :-)

--

-- 
Davide Alberani <davide.alberani@...> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
Chris Spencer | 14 Mar 2009 19:14
Picon
Gravatar

MPAA Ratings

Are the MPAA ratings IMDB distributes as part of
mpaa-ratings-reasons.list.gz accessible via IMDBPy through the Movie
class? I'd like to lookup a movie's MPAA rating, but I don't see any
MPAA related data in the movie infoset. There appears to be a "rating"
key in the Movie class, but this is just for user ratings.

Regards,
Chris

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
Chris Spencer | 14 Mar 2009 21:02
Picon
Gravatar

MPAA Ratings

Are the MPAA ratings IMDB distributes as part of
mpaa-ratings-reasons.list.gz accessible from IMDBPy through the Movie
class? I'd like to lookup a movie's MPAA rating, but I don't see any
MPAA related data in the movie infoset. There appears to be a "rating"
key in the Movie class, but this is just for user ratings.

Regards,
Chris

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com
Davide Alberani | 15 Mar 2009 08:35
Picon
Gravatar

Re: MPAA Ratings

On Mar 14, Chris Spencer <chrisspen@...> wrote:

> Are the MPAA ratings IMDB distributes as part of
> mpaa-ratings-reasons.list.gz accessible from IMDBPy through the Movie
> class?

Sure, but remember that here we're talking about the plain text
data files, and so you should specify what 'data access system'
you're using.

An example for 'sql':

  from imdb import IMDb
  i = IMDb('sql', uri='yourDatabaseURI')
  matrix = i.search_movie('the matrix (1999)')[0]
  i.update(matrix)
  print matrix['mpaa']

If - instead of 'sql' - you plan to use 'local' (a thing to avoid,
if possible), remember that you have to first run the included
'mpaa4local.py' script (mpaa information aren't handled by the mkdb
program, for some reason).

'http' and 'mobile' works the same way, too.

HTH,
--

-- 
Davide Alberani <davide.alberani@...> [PGP KeyID: 0x465BFD47]
http://erlug.linux.it/~da/

------------------------------------------------------------------------------
Apps built with the Adobe(R) Flex(R) framework and Flex Builder(TM) are
powering Web 2.0 with engaging, cross-platform capabilities. Quickly and
easily build your RIAs with Flex Builder, the Eclipse(TM)based development
software that enables intelligent coding and step-through debugging.
Download the free 60 day trial. http://p.sf.net/sfu/www-adobe-com

Gmane