Seema Jethani | 1 Jul 00:48 2016

[ANN] Riak KV 2.0.7

Riak Users,
Riak 2.0.7 was released on June 27th and can be downloaded from the downloads page[1]. This release contains new updates to batching and Solr, Cuttlefish configurations, an OTP upgrade, and fixes for two product advisories[2]Please review the Release Notes [3] for more details before upgrading.

--
Seema Jethani
Director of Product Management, Basho
4083455739 | <at> seemaj 
_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Humberto Rodriguez | 30 Jun 15:02 2016

Rick TS error

Hi, have anyone got this error "vm.args needs to have a -name parameter.” I was trying to test last version (1.3.0) of Riak TS, but every time that I try to start it fails and show me that message

I am using Mac OS The Captain 

Thanks,
Humberto
_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Norman Khine | 29 Jun 21:32 2016
Picon
Gravatar

Amazon EFS and Riak cluster

Hi, with Amazon announcing Elastic File System today, https://aws.amazon.com/efs/ I am curious to know if is a good idea to use EFS?

Any advice much appreciated.

--
%>>> "".join( [ {'*':' <at> ','^':'.'}.get(c,None) or chr(97+(ord(c)-83)%26) for c in ",adym,*)&uzq^zqf" ] )
_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Guido Medina | 29 Jun 16:02 2016

Riak Java client question

Hi,

Are there any plans on releasing a Riak Java client with Netty-4.1.x?

The reasoning for this is that some projects like Vert.x 3.3.0 for 
example are already on Netty-4.1.x and AFAIK Netty's 4.1.x isn't just a 
drop in replacement for 4.0.x

Would it make sense to support another Riak Java client, say version 
2.1.x with Netty-4.1.x as a way to move forward?

Or maybe Riak 2.0.x works with Netty 4.1.x? but I doubt it.

Best regards,

Guido.
Michael Gnatz | 26 Jun 21:55 2016
Picon

exception when listing keys

I am loading very few (around 10!)  rows in my single machine installation (CentOS 7) and with

client.execute(new ListKeys.Builder(TABLE).build());
I get


Caused by: com.basho.riak.client.core.netty.RiakResponseException: {worker_crash,
    {badarg,
        [{'riak_ql_table_SmartMeterData%52$1',extract,2,[{file,[]},{line,4}]},
         {riak_ql_ddl,convert,4,[{file,"src/riak_ql_ddl.erl"},{line,208}]},
         {riak_ql_ddl,build,4,[{file,"src/riak_ql_ddl.erl"},{line,200}]},
         {riak_kv_ts_util,row_to_key,3,
             [{file,"src/riak_kv_ts_util.erl"},{line,393}]},
         {riak_kv_coverage_filter,'-build_preflist_fun/3-fun-0-',4,
             [{file,"src/riak_kv_coverage_filter.erl"},{line,195}]},
         {riak_kv_coverage_filter,'-build_vnode_filter/2-fun-0-',3,
             [{file,"src/riak_kv_coverage_filter.erl"},{line,145}]},
         {riak_kv_vnode,'-fold_fun/4-fun-5-',5,
             [{file,"src/riak_kv_vnode.erl"},{line,1917}]},
         {eleveldb,fold_loop,4,[{file,"src/eleveldb.erl"},{line,540}]}]},
    {fold,#Fun<riak_kv_eleveldb_backend.6.105531631>,
        #Fun<riak_kv_vnode.38.93974927>}}
    at com.basho.riak.client.core.RiakMessage.getRiakErrorFromPbuf(RiakMessage.java:65)
    at com.basho.riak.client.core.RiakMessage.<init>(RiakMessage.java:44)
    at com.basho.riak.client.core.RiakMessage.<init>(RiakMessage.java:31)
    at com.basho.riak.client.core.netty.RiakMessageCodec.decode(RiakMessageCodec.java:59)
    at io.netty.handler.codec.ByteToMessageCodec$1.decode(ByteToMessageCodec.java:42)
    at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:360)
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:244)
    at io.netty.handler.codec.ByteToMessageCodec.channelRead(ByteToMessageCodec.java:103)
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:318)
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:304)
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:846)
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:131)
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:511)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:468)
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:382)
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:354)
    at io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:112)
    at io.netty.util.concurrent.DefaultThreadFactory$DefaultRunnableDecorator.run(DefaultThreadFactory.java:137)
    at java.lang.Thread.run(Thread.java:745)


This does not always happen, but at times.
Any ideas? So far riak is not fun at all.

Regards, Michael

_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Michael Gnatz | 26 Jun 13:26 2016
Picon

data cleanup?

Some newbie question... I want to use Riak TS for saving my time series 
data and I am wondering, how I do the cleanup?
Can I configure somehow that data older than 24 hours gets garbage 
collected?
Marcin Skoczylas | 23 Jun 15:50 2016

Growth of processing queues

Hi,

We have a RIAK cluster with 5 nodes. Since few days we see that 2 of our clusters are quickly getting high number of items in mailbox, giving overall low performance of the cluster (even up to tenths of seconds for processing). But 3 nodes are almost idle... We nailed down that requests are hitting quite big objects (>200kB) and we think this could be the issue.

Are you have similar experience with such processing schema? What parameters shall we tweak to allow Riak handle these requests more quickly and off-load nodes to rest of the cluster?

Thanks in advance,
Marcin

--
Marcin Skoczylas, Ph.D.
QBurst | www.qburst.com
Skype: 
marcin.skoczylas.qburst

_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Nagy, Attila | 22 Jun 14:34 2016
Picon

Memory backend doesn't work (with multi backend)?

Hi,

Trying to use the memory backend via multi.

What I did:
in riak.conf:
storage_backend = multi

Then creating a bucket type:
riak-admin bucket-type create os_cache '{"props": {"write_once": 
true,"backend":"memory","n_val":2,"r":1,"w":1,"dw":1}}'
riak-admin bucket-type activate os_cache

Then I PUT an object:
curl -v -XPUT -H "Content-Type: application/octet-stream" 
'http://localhost:8098/types/os_cache/buckets/os_cache/keys/test1' -d 'test'

Mext, I shut down all of the servers at once, leaving nothing in the 
cluster, then restarting them.
And a new get for the above URL returns "test".

When I set storage_backend to memory, it works as expected, after a full 
cluster stop, the bucket is empty.
Alexander Sicular | 18 Jun 01:43 2016

Riak Recap, June 17th, 2016

Salutations,


Many items to review this weekend. A number of client library updates, a blog post and some github repos along with the mailing list review, as per usual.


As always, we want to hear from you. Let me know if you’re working on or speaking about something Riak related and would like a shoutout. I’ll get your talk, project or blog post in the next Riak Recap.



## Announcements


  • Ruby Client 2.4.0 - gzip support, connection timeouts and time conversions [0].

  • Golang 1.7.0 - initial Riak TS support [1].

  • Python 2.5.3 - bug fix release [2].

  • Node 2.2.0 - compatibility with Riak TS 1.3, backoff on retries, timeouts among other updates [3].


## Community Code and Walkthroughs


  • Craig Vitter has started a JDBC client for Riak TS. Take it out for a spin, contributions welcome [4].

  • Stephen Etheridge recently spoke at the PyData London meetup and here’s a link to the repo he reviewed there [5].

  • My blog post on data modeling in Riak TS was recently published on Basho’s blog [6].




##Community Events


  • Basho will be at O’Reilly’s Velocity conference in Santa Clara next week [7]. Stop by and say hello.



## Jobs at Basho


Interested in working on distributed computing related problems or helping our community with theirs? We’re hiring.


  • Client Services Engineer (USA) [8].

  • Developer Advocate (London and US) [9].


Yes, you can work from home!



## Recently Answered


  • Russell Brown answers a StackOverflow question on context for Riak KV’s Flag datatype [10].

  • Norman is looking to use Riak as a session store backing his NodeJS app. Luke and Alex let him know that Riak is well suited as a session store backing but we do not have all the framework/language combinations readily available. The proposal is to use the memcached session store lib as a stub and swap out the memcached client lib with Riaks NodeJS client lib [11].

  • A number of folks work with Jan to troubleshoot how best to restart a Riak cluster in Kubernetes [12]. Riak likes statefulness between reboots. Some managers will bring a node back with a new name, that needs to be addressed. Take a look at our Mesos integration if you’re working in that environment [13].

  • Guillaume is looking to mass update all json objects in his cluster and update the structure [14]. Consider Riak KV is non-relational by nature and all values are opaque to it. Riak KV also has no SQL like language to do a select/update cycle.

  • Magnus helps Satish get Riak Control working on Riak KV 1.4.12 [15]. I would recommend updating to the latest version at your earliest convenience ;)

  • Luke reminds Abhinav to follow the tuning guidelines when working through performance related issues [16]. Ryan also points out that the minimum production deployment recommendation is five nodes [17]. When writing three replicas to a cluster with less than five nodes you are guaranteed to have more that one copy written to the same physical machine in for some set of data.

  • Henrik is looking for official work on Solaris/OmniOS/illumos support [18]. It’s true, we will no longer be supporting those environments. Take a look at Ubuntu’s support for ZFS if you are looking to use that filesystem in your environment.

  • In a similar request to Guillaume’s, Ricardo is also looking to mass update his json documents [19]. Luke links to some advanced map/reduce that may help get the job done [20].

  • Gianluca presents a data retrieval data modeling question [21] and is looking for recommendations on how best to proceed.




## Open Discussions


  • Russell and Luke continue to work with Vladyslav on sibling explosion in Riak CS [22].

  • Johnny is looking for some help on his bitcask merge issue [23].

  • Vladyslav is looking for clarification on the meaning of “riak-admin node down” [24], particularly in the face of node failure during a cluster resizing operation.

  • Kyle is looking for information on Riak TS drop table functionality and HTTP auth support [25].

  • Guillaume kicks off a conversation on custom Solr configs [26] and Luke points to an open issue on github reviewing some considerations [27].

  • Anil is looking for ways to copy Solr indecies from one machine to another [28].

  • Murali is looking for information around Riak S2 (formerly CS) performance on a single node [29].

  • Vladimir asks the list for help with the following warning “perflists do not satisfy the n_val” [30].

  • Alex is looking for advice regarding whether or not Riak TS would be better suited in certain use cases over Riak KV for his social network project [31].

  • Michael is looking for some guidance on properly sizing a Riak S2 cluster [32].

  • Psterk is looking for help on using hadoops’s distcpy to copy files from Riak S2 to hadoop [33][34].



Peace and love,


-Alexander Sicular

Solution Architect, Basho

<at> siculars


[0] https://github.com/basho/riak-ruby-client/blob/master/RELNOTES.md

[1] https://github.com/basho/riak-go-client/blob/master/RELNOTES.md

[2] https://github.com/basho/riak-python-client/blob/master/RELNOTES.md

[3] https://github.com/basho/riak-nodejs-client/blob/master/RELNOTES.md

[4] https://github.com/cvitter/Riak-TS-JDBC-Driver

[5] https://github.com/datalemming/PDL-notebooks

[6] http://basho.com/posts/technical/what-does-time-series-mean-to-me/

[7] http://conferences.oreilly.com/velocity/devops-web-performance-ca

[8] http://bashojobs.theresumator.com/apply/0CTNKU/Client-Services-Engineer-Remote

[9] http://bashojobs.theresumator.com/apply/nVY7Ea/Developer-Advocate-EMEA

[10] https://stackoverflow.com/questions/37728202/what-does-the-context-for-flags-relate-to-in-riak-kv/37729256#37729256

[11] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018510.html

[12] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018518.html

[13] https://github.com/basho-labs/riak-mesos

[14] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018525.html

[15] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018528.html

[16] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018538.html

[17] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018534.html

[18] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018533.html

[19] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018535.html

[20] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018539.html

[21] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018543.html

[22] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018513.html

[23] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018551.html

[24] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-June/018548.html

[25] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018389.html

[26] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018483.html

[27] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018500.html

[28] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018469.html

[29] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018478.html

[30] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-May/018375.html

[31] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-April/018279.html

[32] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-March/018242.html

[33] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-April/018321.html

[34] http://lists.basho.com/pipermail/riak-users_lists.basho.com/2016-April/018322.html


_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com
Luke Bakken | 17 Jun 22:01 2016
Gravatar

Riak Node.js client 2.2.0 released

Hello everyone,

I released version 2.2.0 of the Riak Node.js client today. More
information is available at the following links:

https://github.com/basho/riak-nodejs-client/blob/master/RELNOTES.md

https://github.com/basho/riak-nodejs-client/issues?q=milestone%3Ariak-nodejs-client-2.2.0

https://github.com/basho/riak-nodejs-client/releases/tag/v2.4.0

https://www.npmjs.com/package/basho-riak-client

Thanks!

--
Luke Bakken
Engineer
lbakken <at> basho.com
Vladyslav Zakhozhai | 16 Jun 22:27 2016
Picon

riak-admin down NODE meaning

Hello,

I thought that I know the meaning of command riak-admin down NODE pretty sure. Till this evening.

So the question is what is explicit meaning of this command?

My opinion was the following. During ownership handoff (maybe hinted handoffs also, I am not sure) when one of the members of riak cluster fails handoff stops till riak-admin down FAILED_NODE_NAME provided.

For example there is 7 nodes: A, B, C, D, E, F, G. F and G are the nodes just joined to riak cluster and are awaiting to receive partitions from A, B and C. During ownership handoff node E fails. In this case all ownership handoffs may be stopped till riak-admin down E command is provided.

Am I right? Or when I provide such command all ring will be replanned?

Unfortunately description of this command is not clear in official docs.

Today when my cluster plan was almost completed one of the riak nodes failed (this node was not a participant in ownership handoffs). And then in riak-admin ring-status I see 5 partitions is awaiting ownership transfer instead of only one.

It confused me very match. I was looking forward to complete this cluster plan to join new nodes to cluster. In my case I need to wait for completion of ownership transfer for this 5 partition that can took 5-7 days (existing nodes experiencing lack of resources). Unfortunately I do not have so much time.

Thank you. 
_______________________________________________
riak-users mailing list
riak-users <at> lists.basho.com
http://lists.basho.com/mailman/listinfo/riak-users_lists.basho.com

Gmane