headers
Jack Royal-Gordon | 17 May 2013 08:25
Picon
Favicon

Logs seem awfully big

I'm using LogEntries to store my sys logs, but I'm apparently generating a very large log volume
(~87GB/~270M events per day).  My app has relatively few users (100) who use it very lightly (16,665 HTTP
Requests per day).  The main cause seems to be that my inserts can be very large (including web pages that I
have scraped), and when they are logged it includes the entire contents of the web page (over 1000 lines per
insert, 25,000 inserts into the web page table per day).  I have asked Heroku about any of the following:

1) Shorten the logging entry from Postgres inserts to truncate the field listings
2) Disable the logging of long-running Heroku commands

The response I got is that none of these is possible, and yet LogEntries Support tells me that they had
another user in the past who was able to get Heroku to stop logging from their Postgres database.

Does anyone know how to accomplish one of these tweaks?

-- 
--

-- 
You received this message because you are subscribed to the Google
Groups "Heroku" group.

To unsubscribe from this group, send email to
heroku+unsubscribe@...
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en

--- 
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe@...
For more options, visit https://groups.google.com/groups/opt_out.
(Continue reading)

Permalink | Reply | 2 comments |
headers
Jack Oekaki | 15 May 2013 08:34
Picon

Really uneven dyno performance

Has anyone else experienced severe fluctuations in the execution speed
of your dynos? I have a largely CPU-bound app that (AFAIK) does a
fairly consistent amount of work per request (very very few ultra long
requests, ala Rap Genius), yet I've seen average request times vary by
as much as 5x from hour to hour even though the level of traffic is
steady and even though the mix of requests is unchanged.

I've been assuming that it's my fault; a bottleneck in something I
haven't been able to measure or something. I'm using New Relic, but
all the external services seem unaffected and the performance drop
seems uniformly distributed throughout all the profiling segments.

The thing that's prompted me to ask is that I've recently had a day
long stint where everything ran like crap. Usually it's fleeting. May
12th 2000hrs UTC till May 13th 2400hrs had lag spikes around every 5
minutes and timeouts all over the place. I've got to get to the bottom
of this. So, what's average for heroku?

Thanks

-- 
--

-- 
You received this message because you are subscribed to the Google
Groups "Heroku" group.

To unsubscribe from this group, send email to
heroku+unsubscribe@...
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
(Continue reading)

Permalink | Reply | 1 comment |
headers
michaelspb | 10 May 2013 10:37
Picon

Chinese firewall - connection to heroku from China

50% of time website hosted at heroku cannot be loaded. Is there any solutions for users in China?

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 3 comments |
headers
Tam Nguyen | 6 May 2013 18:52
Picon
Gravatar

Problem deploying Nodejs apps to Heroku as production

So I have a Nodejs app that I need to deploy onto Heroku as production. I have a Procfile, which specifies to run 3 web processes. Only one of them gets run on Heroku:


[ec2-user <at> ip-10-0-1-249 NodeApps]$ cat Procfile
web: node Applications/Dashboard/app.js
web: node Applications/PortalAPIs/portalAPIs.js
web: node Applications/Sockets/appSocket.js

[ec2-user <at> ip-10-0-1-249 NodeApps]$ heroku ps
=== web (1X): `node Applications/Sockets/appSocket.js`
web.1: crashed 2013/05/06 16:43:59 (~ 3m ago)

The rest don't get run. I think what happens is my production environment doesn't get recognized for some reason. Here's the foreman log:

[ec2-user <at> ip-10-0-1-249 NodeApps]$ foreman start
16:48:35 web.1  | started with pid 4545
16:48:35 web.1  | started with pid 4546
16:48:35 web.1  | started with pid 4547
16:48:35 web.1  | Started process pid: 4545
16:48:35 web.1  | Started process pid: 4546
16:48:35 web.1  | Started process pid: 4547
16:48:35 web.1  | info: socket.io started
16:48:35 web.1  | { domain: null,
16:48:35 web.1  |   _events:
16:48:35 web.1  |    { request: [Function],
16:48:35 web.1  |      connection: [Function: connectionListener],
16:48:35 web.1  |      clientError: [Function],
16:48:35 web.1  |      error: [Function],
16:48:35 web.1  |      upgrade: [Function],
16:48:35 web.1  |      close: [Function],
16:48:35 web.1  |      listening: { [Function: g] listener: [Function] } },
16:48:35 web.1  |   _maxListeners: 10,
16:48:35 web.1  |   _connections: 0,
16:48:35 web.1  |   connections: [Getter/Setter],
16:48:35 web.1  |   _handle:
16:48:35 web.1  |    { fd: 18,
16:48:35 web.1  |      writeQueueSize: 0,
16:48:35 web.1  |      onconnection: [Function: onconnection],
16:48:35 web.1  |      owner: [Circular] },
16:48:35 web.1  |   _usingSlaves: false,
16:48:35 web.1  |   _slaves: [],
16:48:35 web.1  |   allowHalfOpen: true,
16:48:35 web.1  |   httpAllowHalfOpen: false,
16:48:35 web.1  |   timeout: 120000,
16:48:35 web.1  |   _connectionKey: '4:0.0.0.0:5001' }
16:48:36 web.1  | mongodb://10.61.2.112/portal
16:48:36 web.1  | mongodb://10.61.2.112/portal
16:48:36 web.1  | connection error: { [Error: Trying to open unclosed connection.] state: 2 }
16:48:36 web.1  | connection error: { [Error: Trying to open unclosed connection.] state: 2 }
16:48:36 web.1  | connection error: { [Error: Trying to open unclosed connection.] state: 2 }
16:48:36 web.1  | Listening on port 3000...
16:48:36 web.1  | DB Connection Open!
16:48:36 web.1  | DB Connection Open!
16:48:36 web.1  | DB Connection Open!
^CSIGINT received
16:48:39 system | sending SIGTERM to all processes
16:48:39 web.1  | exited with code 130

As you can see, it keeps using my local mongodb connection string. Here's my env:

[ec2-user <at> ip-10-0-1-249 NodeApps]$ heroku config
=== pure-badlands-3473 Config Vars
GITHUB_USERNAME:      [redacted}
MONGOLAB_URI:         [redacted}
NEWRELIC_LICENSE_KEY: [redacted}
NODE_ENV:             production
PATH:                 bin:node_modules/.bin:/usr/local/bin:/usr/bin:/bin
dbConnectionUrl:      [redacted}

What am I doing wrong? Please help me, and feel free if you need any more info.

Thanks so much!

-Tam

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 9 comments |
headers
himusanna | 5 May 2013 09:53
Picon

Please help in creating Database for a facebook game

Hi,
I created a facebook game like iphone's "icon mania" using javascript and php. The game is hosted on heroku. Now i want to save user's facebook id,  level and earned coin so that later when he again come back to play my game need not to start from the beginning.
Now my question is how can i do this ?? I have seen that heroku supports database for facebook apps. which database should use for this purpose ?? sql lite or mysql ?? How can integrate database to my current code ?? can anyone help me in this regard ??? Is there anyone who can share a sample code for database integration for php on heroku ??

Thanks in advance.

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 0 comments |
headers
Josh Coffman | 30 Apr 2013 18:40
Picon
Gravatar

rails 3.2 MongoLab, ruby 2.0

Hi,

  I'm having trouble connecting to mongolab from a rails 3.2 app using ruby 2.0. I have tried using the URI and specifying the database, hosts, and user info. Both ways I still get the error: No sessions configuration provided.

  Has anyone else seen this? Could it be related to using Ruby 2.0. That's the only thing I can think of that changed recently for this site.

-josh

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 0 comments |
headers
Josh Kraemer | 29 Apr 2013 21:29
Picon
Gravatar

Force http

Is there a way I can force http on Heroku?


I know I can do it on the rails app level, but that doesn't catch the mismatch certificate error. Here's my current setup:

http://example.com -> http://www.example.com (forwarded through Godaddy)
http://www.example.com is cname for http://example.herokuapp.com

I would like this to happen:

https://www.example.com -> http://www.example.com

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 0 comments |
headers
Michel Pigassou | 29 Apr 2013 17:23
Picon
Gravatar

pgbackups:restore not destroying the database?

Hi.


Several times I have used pgbackups:restore for a Rails database and it messed with my migrations, saying that the table already exist.
In this case I resolve the situation by resetting the DB (pg:reset) and then restoring it.

But it says here https://devcenter.heroku.com/articles/pgbackups#restoring-from-backup that "Restoring a backup is a destructive operation: the restore operation will drop existing data and replace it with the contents of the backup.". However this was not my experience.

Any comment or suggestion?

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 2 comments |
headers
Jonas Windey | 16 Apr 2013 07:57
Picon

Single app with multiple processes vs multiple apps with single process

What are the benefits of putting multiple dyno's (ex. web and worker) on a single app compared to putting each dyno on a separate app?

In terms of scalability, it would be the same since each dyno can be scaled no matter how it's setup.

The only real advantage I could see is that env variables are shared on the same app, but that is something that can be overruled in the latter setup too.

The biggest advantage for the second setup is of course a free dyno/month for each app.


--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 6 comments |
headers
William Billingsley | 16 Apr 2013 05:35
Picon

502 Bad Gateway, is there a way to discover what Heroku objected to in the response?

Is there a way to find out *what* Heroku's proxy objected to in a response?


I have an app which on its Server Sent Events url gets a 502 Bad Gateway on Heroku (but for which its other urls work fine, and the app's own log messages suggest the app did try to respond)

When I run the app on localhost, this is the output from cURL to the event stream, and I'm trying to work out if there's any part of this response that Heroku's proxy would object to, that would cause it to "502 Bad Gateway" on Heroku.

$ curl -N -v http://localhost:9000/eventRoom/ssevents
* About to connect() to localhost port 9000 (#0)
*   Trying ::1...
* connected
* Connected to localhost (::1) port 9000 (#0)
> GET /eventRoom/ssevents HTTP/1.1
> User-Agent: curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8r zlib/1.2.5
> Host: localhost:9000
> Accept: */*
> 
< HTTP/1.1 200 OK
< Connection: close
* Negative content-length: -1, closing after transfer
< Content-Length: -1
< Content-Type: text/event-stream
< Set-Cookie: PLAY_SESSION=c115bf50b75969eeb9b9751b66f481829a1fd5c0-sessionkey%3A516cc2339acb3a6b00380eac; Path=/; HTTPOnly
< 
data: {"type":"ignore"}

data: {"type":"connected","listenerName":"516cc2339acb3a6b00380eab"}

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 2 comments |
headers
Jason Joseph | 12 Apr 2013 22:17
Gravatar

Heroku Postgres Performance Notes

We've been doing some hefty performance testing of the Heroku Postgres dbs with the help of some of the people on the data team (thank you guys!) and we just wanted to share some rough performance numbers that hopefully might help you when you're selecting a db type next time.

Setup: We have some large ETL operations that obviously are very write heavy and we wanted to get an idea which db tier was best in terms price/performance. We're using the COPY command to move 2 million rows of data from one db (a zilla) to another and we wanted to get an idea of what the performance differences were between the tiers. The Zilla that is being copied from doesn't change between tests and for each new test we spin up a new db to make sure we are testing from a clean slate.

DB Type - Time to copy in minutes

Ronin - 35:04
Fugu - 26:43
Ika - 8:34
Zilla - 7:22

We didn't test a mecha (yet) or anything below Ronin because the COPY literally wouldn't complete on anything lower than that.

One thing we did realize with the help of the Heroku PG team is that there is some serious variance in performance on newly provisioned dbs. They are currently hypothesizing that it is related to the nature of the dynamic disk space provisioning that happens as large amounts of data are inserted into a freshly provisioned db. We saw in many instances close to 50% slower speeds. Sometimes it would run normally (those are the values we listed above) but for example on the Ika runs, we would sometimes see it take close to ~15 minutes to complete the copy. After some initial hiccups though we believe all dbs move towards there normal performance numbers listed above so just keep that in mind when you are provisioning a new db.

Anyways, hope this was helpful and we would love to hear from anyone else doing performance testing on the PG dbs.

--
--
You received this message because you are subscribed to the Google
Groups "Heroku" group.
 
To unsubscribe from this group, send email to
heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFFw@public.gmane.org
For more options, visit this group at
http://groups.google.com/group/heroku?hl=en_US?hl=en
 
---
You received this message because you are subscribed to the Google Groups "Heroku Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email to heroku+unsubscribe-/JYPxA39Uh5TLH3MbocFF+G/Ez6ZCGd0@public.gmane.org
For more options, visit https://groups.google.com/groups/opt_out.
 
 
Permalink | Reply | 2 comments |

Gmane