Jeff Charette | 13 Feb 00:06 2016

Contract Dev Help

Hi everyone,

Not sure if this is the right place to ask, but we are running CouchDB in a production environment and are
having serious performance issues on only 7000 documents.  I am looking for someone I can pay to take a look,
as even after 6 years of Couchdb experience I am at my wits end as to what the issue is. I’m happy to copy and
paste multiple verbose logs, but I believe in the end we may need someone with a bit more experience to take a look.

We are using the changes feed with event source for syncing approximately 300 devices and are crashing a
16GB 8 core instance on Digital ocean.  Beam.smp seams to eat all the memory over a 24 hour period.  Any help or
guidance would be greatly appreciated.

Best,

Jeff Charette | Principal 
We Are Charette
web / identity / packaging

w  wearecharette.com <http://wearecharette.com/>

IRS CIRCULAR 230:  Unless explicitly stated to the contrary, this communication (including any
attachments) is not intended or written to be used, and cannot be used, for the purpose of (i) avoiding
penalties under the Internal Revenue Code or (ii) promoting, marketing, or recommending to another
party any transaction or matter addressed herein.

CONFIDENTIALITY:  This email and any attachments may be confidential and/or privileged and are therefore
protected against copying, use, disclosure or distribution.  If you are not the intended recipient,
please notify us immediately by replying to the sender and double deleting this copy and the reply from
your system.

(Continue reading)

Jenn Turner | 11 Feb 20:54 2016

The CouchDB Weekly News, February 11, is out 📰

Hi folks! 😎

The CouchDB Weekly News is out:

http://blog.couchdb.org/2016/02/11/couchdb-weekly-news-february-11-2016/

Highlights:

- We welcome a new committer!
- Stuff is happening with CouchDB PPAs and Ubuntu
- Kanye West deletes his Twitter account

Thanks to Anik, Robert, and Dave for submitting content this week!
👏🏻

Please help us promote the News: https://twitter.com/CouchDB/status/697870164482719744
We’d invite you to share the link in the social networks you use to help us promote CouchDB.

Thank you ☺️

—
Jenn Turner
The Neighbourhoodie Software GmbH
Adalbertstr. 7-8, 10999 Berlin
neighbourhood.ie

Handelsregister HRB 157851 B Amtsgericht Charlottenburg
Geschäftsführung: Jan Lehnardt

(Continue reading)

Melissa Warnkin | 11 Feb 19:23 2016

ApacheCon NA 2016 - Important Dates!!!

 Hello everyone!
I hope this email finds you well.  I hope everyone is as excited about ApacheCon as I am!
I'd like to remind you all of a couple of important dates, as well as ask for your assistance in spreading the
word! Please use your social media platform(s) to get the word out! The more visibility, the better
ApacheCon will be for all!! :)
CFP Close: February 12, 2016CFP Notifications: February 29, 2016Schedule Announced: March 3, 2016
To submit a talk, please visit:  http://events.linuxfoundation.org/events/apache-big-data-north-america/program/cfp

Link to the main site can be found here:  http://events.linuxfoundation.org/events/apache-big-data-north-america

Apache: Big Data North America 2016 Registration Fees:
Attendee Registration Fee: US$599 through March 6, US$799 through April 10, US$999
thereafterCommitter Registration Fee: US$275 through April 10, US$375 thereafterStudent
Registration Fee: US$275 through April 10, $375 thereafter
Planning to attend ApacheCon North America 2016 May 11 - 13, 2016? There is an add-on option on the
registration form to join the conference for a discounted fee of US$399, available only to Apache: Big
Data North America attendees.
So, please tweet away!!
I look forward to seeing you in Vancouver! Have a groovy day!!
~Melissaon behalf of the ApacheCon Team

Peter Figliozzi | 11 Feb 19:10 2016
Picon
Gravatar

Getting EventSource changes feed working

I am trying to get the changes feed working using the Event Source method.
Here is the example from the docs
<http://docs.couchdb.org/en/1.6.1/api/database/changes.html>:

// define the event handling function
> if (window.EventSource) {
>   var source = new EventSource("/somedatabase/_changes?feed=eventsource");
>
>   var results = [];
>   var sourceListener = function(e) {
>     var data = JSON.parse(e.data);
>     results.push(data);
>   };
>   // start listening for events
>   source.addEventListener('message', sourceListener, false);
>   // stop listening for events
>   source.removeEventListener('message', sourceListener, false);
> }

When I work up something similar, I get the following error message:

EventSource's response has a MIME type ("text/plain") that is not
"text/event-stream". Aborting the connection.

*So I believe I need to tell the changes feed to use "text/event-stream"
instead of "text/plain".  How is that done?*

In this case I am working from the browser, passing the url in the
EventSource constructor:

(Continue reading)

Jenn Turner | 8 Feb 00:54 2016

[NEWS] Your links for the CouchDB Weekly News?

Hello there! 🏈

If you want to submit a link for this week’s CouchDB Weekly News, please don’t hesitate and send it to
this thread until Thursday, February 11, 11am UTC+2.

Thanks in advance for your support, and have a great rest of your Sunday! 👋🏻

Jenn

—
Jenn Turner
The Neighbourhoodie Software GmbH
Adalbertstr. 7-8, 10999 Berlin
neighbourhood.ie

Handelsregister HRB 157851 B Amtsgericht Charlottenburg
Geschäftsführung: Jan Lehnardt

Florin Andrei | 4 Feb 23:29 2016
Gravatar

replication over higher latency link

couchdb-1.6.1 on Ubuntu 14.04

Continuous replication (pull) works great with the default settings when 
the two ends of the connection are near each other.

But I'm replicating now from Oregon to N. Virginia, and the ping 
roundtrip latency is about 80 ms. Replication is now much slower. I've 
checked all possible bottlenecks - it's not the CouchDB instances, it's 
not the VPN instances, it's not the network bandwidth.

I can only hypothesize that the slow replication speed is due to 
increased latency.

I'm looking at this list of settings:

https://wiki.apache.org/couchdb/Replication#New_features_introduced_in_CouchDB_1.2.0

Which ones would be useful in this case to speed up replication? It 
seems like worker_processes and worker_batch_size would be good 
candidates - does that sound right? Anything else I need to consider?

--

-- 
Florin Andrei
http://florin.myip.org/

Jenn Turner | 4 Feb 15:58 2016

[NEWS] The CouchDB Weekly News, February 4, is out 📰

Hi folks! 😎

The CouchDB Weekly News is out:

http://blog.couchdb.org/2016/02/04/couchdb-weekly-news-february-4-2016/

Highlights:

- Some really great new releases in CouchDB.

- But also a pretty important one for PouchDB too.

- A highly opinionated piece on animals at the Academy Awards.

Thanks to Dave, Andy, and Martin for submitting content this week! 👏🏻

Please help us promote the News https://twitter.com/CouchDB/status/695258568627478528

We’d invite you to share the link in the social networks you use to help us promote CouchDB.

Thank you ☺️

—
Jenn Turner
The Neighbourhoodie Software GmbH
Adalbertstr. 7-8, 10999 Berlin
neighbourhood.ie

Handelsregister HRB 157851 B Amtsgericht Charlottenburg
Geschäftsführung: Jan Lehnardt
(Continue reading)

Michael Power | 3 Feb 22:40 2016

Couchdb 1.x and 2.x partitions

Hello,

I have a use case where I am building up a lot of read only data for specific time periods.  I might bucket each
dataset daily, and then after a certain number of days I want to throw away the data.  I imagine doing a delete
of each record that is old will be expensive in execution and also create a lot of versions inside the
database slowing down the database as a whole and driving the need to do a compaction.  Does couchdb have a
way to partition the data, so that I can do a bulk delete of that data quickly without degrading the storage
of the database with unused sections?

At this point in time, I can only think of creating a new database that is dated.  Insert into it, then when it
expires delete the whole database.  This forces the clients to be aware of the partitions, they would have
to query the correct database given the date range they are interested in.  Is there a way I can hide the
partitions from the clients?

Michael Power
Nick Wood | 2 Feb 23:18 2016
Picon

Canceling a replication taking a long time

$ time curl -H 'Content-Type: application/json' -X POST
http://admin:*** <at> ***:5984/_replicate
-d ' {"replication_id":
"31036d544cba80ac6c1ff0340b01e992+continuous+create_target", "cancel":
true} '
{"error":"not found"}

real 1m23.768s
user 0m0.004s
sys 0m0.006s

Most of the time replications delete very quickly, but if I try to cancel a
replication shortly after it's been started, sometimes it takes a very long
time - several minutes in some cases.

Any idea why cancelling a replication might take so long?

fyi, I had another process trying to delete this replication, which is why
this one got the not_found by the time it was handled.

  Nick
Anik Das | 2 Feb 22:08 2016
Picon
Gravatar

Storage Issues on 600,000 document insertion

Hello All,

We were developing an application where we had to insert approximately 600,000
documents into a database. The database had only one view (value emitted as
null).

It was not a batch insertion. After the insertion the database took up 3.5GB
to our wonder. I googled around and did a compact query. After the compact
query the size reduced to 350MB.

I am new to couchdb and I'm unable to figure out what exactly is
happening/happened.  

Anik Das

Jenn Turner | 31 Jan 23:30 2016

[NEWS] Your links for the CouchDB Weekly News?

Hi CouchDB potatoes! 😎

February is basically here!

If you want to submit a link for this week’s CouchDB Weekly News, please don’t hesitate and send it to
this thread until Thursday, February 4, 11am UTC+2.

Thanks, have a great rest of your Sunday! 👋🏻

Jenn

—
Jenn Turner
The Neighbourhoodie Software GmbH
Adalbertstr. 7-8, 10999 Berlin
neighbourhood.ie

Handelsregister HRB 157851 B Amtsgericht Charlottenburg
Geschäftsführung: Jan Lehnardt


Gmane