Spark is a fast, Hadoop-compatible cluster computing system that lets you write programs using standard Scala functional operations (map, filter, reduce, etc) and automatically distributes them over a cluster. It supports in-memory computation to significantly speed up multi-stage applications, and can be used directly from the Scala console to query large datasets interactively. Check out http://spark-project.org for more details and http://spark-project.org/examples.html for some sample code.

The 0.5 release brings several new features, including:
- New operators: parallel sorting, fold, aggregate, and a new sampling operator.
- Performance improvements: faster shuffle implementation and better cache management.
- Debugging improvements: Spark now reports remote exceptions at the master and filters duplicates.
- Support for running on Apache Mesos 0.9.
- Improved EC2 launch scripts.

For more details, or to download the release, visit http://www.spark-project.org/release-0.5.0.html. You can also keep up with Spark development on GitHub: https://github.com/mesos/spark.

Matei & the Spark team

We are very happy to announce a new release candidate of the Scala IDE for Eclipse! 2.0.2 is a maintenance release containing only bug fixes.

A final 2.0.2 release will follow in 7 days if no issue is reported. Please help us with the testing of this candidate, and let us know of any issues that you may encounter.

What’s new?

Better support for JDK 7

The Scala presentation compiler used to (incorrectly) use the running JDK, instead of the one configured on the build path. Now it will honor the correct JDK, meaning that Eclipse can run on JDK 6, but your project can compile against JDK 7.

Better support for nested projects

Importing your multi-module project in the Scala IDE has never been a problem. However, compilation errors in a nested project used to be reported in the top-level project, which was of course confusing. That is fixed now, and we know the Maven lovers will like it.

Better support for mixed Java/Scala projects

For the many of you working with mixed Java/Scala projects, we have been fixing an annoying issue related to <at> throw annotation, which was causing incorrect errors to be reported in the Java editor.

Changelog

• Missing Scala library in run classpath - #1000786, #1000919, #1001022
• Provide reusable sdt.core.tests bundle - #1001080
• Problem deleting files on Windows - #1000909, #1000923
• Removed code generation groups from editor’s context menu - #1000972
• Correctly expose Scala <at> throw annotation to Java - #1000707, #1000800, #1001005
• Support nested projects (Maven style) - #1000881, #1000734, #1000621
• Fixed crash in tooltip launch button - #1000951
• Made Run As Scala Application more robust - #1000911
• Use the configured JDK when instantiating the presentation compiler. - #1000820

Get 2.0.2-RC1 Now!

We are very happy to announce a new release candidate (RC2) for the next maintenance release of the Scala IDE for Eclipse.

There are only two changes with respect to 2.0.2 RC1:

• A fix for the Scala launch configuration (#1001096).
• A warning dialog is now displayed if JDT Weaving is disabled (#1001104).

Read the release notes for finding out what’s new in this 2.0.2 maintenance release.

Get 2.0.2-RC2 Now!