Planet Apache

Syndicate content
Updated: 1 day 1 hour ago

Edward J. Yoon: 아마존 프라임 에어

Sat, 2014-07-12 00:31


아마존의 무인 택배 서비스 '프라임 에어'.
드론이 GPS 기반으로 주소지를 찾아가서 떨구면 끗!
국내에도 노인들이 많은 시골같은 곳은 유용할 것 같다.
Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-11

Fri, 2014-07-11 18:58
  • Netflix/ribbon

    a client side IPC library that is battle-tested in cloud. It provides the following features: Load balancing; Fault tolerance; Multiple protocol (HTTP, TCP, UDP) support in an asynchronous and reactive model; Caching and batching. I like the integration of Eureka and Hystrix in particular, although I would really like to read more about Eureka’s approach to availability during network partitions and CAP. https://groups.google.com/d/msg/eureka_netflix/LXKWoD14RFY/-5nElGl1OQ0J has some interesting discussion on the topic. It actually sounds like the Eureka approach is more correct than using ZK: ‘Eureka is available. ZooKeeper, while tolerant against single node failures, doesn’t react well to long partitioning events. For us, it’s vastly more important that we maintain an available registry than a necessary consistent registry. If us-east-1d sees 23 nodes, and us-east-1c sees 22 nodes for a little bit, that’s OK with us.’ See also http://ispyker.blogspot.ie/2013/12/zookeeper-as-cloud-native-service.html which corroborates this: I went into one of the instances and quickly did an iptables DROP on all packets coming from the other two instances. This would simulate an availability zone continuing to function, but that zone losing network connectivity to the other availability zones. What I saw was that the two other instances noticed that the first server “going away”, but they continued to function as they still saw a majority (66%). More interestingly the first instance noticed the other two servers “going away” dropping the ensemble availability to 33%. This caused the first server to stop serving requests to clients (not only writes, but also reads). [...] To me this seems like a concern, as network partitions should be considered an event that should be survived. In this case (with this specific configuration of zookeeper) no new clients in that availability zone would be able to register themselves with consumers within the same availability zone. Adding more zookeeper instances to the ensemble wouldn’t help considering a balanced deployment as in this case the availability would always be majority (66%) and non-majority (33%).

    (tags: netflix ribbon availability libraries java hystrix eureka aws ec2 load-balancing networking http tcp architecture clients ipc)

  • The Myth of Schema-less [NoSQL]

    We don’t seem to gain much in terms of database flexibility. Is our application more flexible? I don’t think so. Even without our schema explicitly defined in our database, it’s there… somewhere. You simply have to search through hundreds of thousands of lines to find all the little bits of it. It has the potential to be in several places, making it harder to properly identify. The reality of these codebases is that they are error prone and rarely lack the necessary documentation. This problem is magnified when there are multiple codebases talking to the same database. This is not an uncommon practice for reporting or analytical purposes. Finally, all this “flexibility” rears its head in the same way that PHP and Javascript’s “neat” weak typing stabs you right in the face. There are some somethings you can be cavalier about, and some things you should be strict about. Your data model is one you absolutely need to be strict on. If a field should store an int, it should store nothing else. Not a string, not a picture of a horse, but an integer. It’s nice to know that I have my database doing type checking for me and I can expect a field to be the same type across all records. All this leads us to an undeniable fact: There is always a schema. Wearing “I don’t do schema” as a badge of honor is a complete joke and encourages a terrible development practice.

    (tags: nosql databases storage schema strong-typing)

  • Latest EBS tuning tips

    from yesterday’s AWS Summit in NYC:

    Cheat sheet of EBS-optimized instances. http://t.co/vmTlhUtpWk Optimize your queue depth to achieve lower latency & highest IOPS. http://t.co/EO48oa0D6X When configuring your RAID, use a stripe size of 128KB or 256KB. http://t.co/N0ldtFJ4t6 Use larger block size to speed up the pre-warming process. http://t.co/8UoIeWE2px

    (tags: ebs aws amazon iops raid ops tuning)

Categories: FLOSS Project Planets

Bryan Pendleton: Stuff I'm reading, World Cup finals weekend edition

Fri, 2014-07-11 18:03

I know it's summertime, because we get to attend the first performance of the summertime outdoor community theater at Oakland's Woodminster Theater this weekend, yay!

And when I'm not at the theater, at least I won't be bored:

  • A Proper Server Naming SchemeSince we’re starting fresh with this data center, we wanted to come up with our own naming scheme to address the common problems we’ve seen elsewhere. We gleaned ideas from numerous sources such as data published by large-scale companies, various RFC‘s on the topic, and blog/forum posts a’plenty. Taking all of that into account, we’ve developed some best practices that should work for most small-to-medium businesses naming their own hardware.
  • Finding All the Red M&Ms: A Story of Indexes and Full‑Table ScansA common question that comes up when people start tuning queries is “why doesn’t this query use the index I expect?”. There are a few myths surrounding when database optimizers will use an index. A common one I’ve heard is that an index will be used when accessing 5% or less of the rows in a table. This isn’t the case however - the basic decision on whether or not to use an index comes down to its cost.
  • Fallacies of the Cost Based OptimizerThis paper identifies three basic assumptions made by the cost based optimizer in the estimation of cardinalities of the results of relational operations on the base and intermediate row sources and ultimately the query result set.
  • Cache coherency primerThis is a whirlwhind primer on CPU caches. I’m assuming you know the basic concept, but you might not be familiar with some of the details.
  • "I actually was hunting Ewoks." The Original Lucasfilm Games Team Talk About Life at Skywalker Ranch.Booger Hunt. George Lucas avoiding tax penalties. Monkey Island and dependency charts. The Lost Patrol. A file drawer full of crazy ideas. This is the story about life at Lucasfilm Games - as told by the people who lived it.
  • Procedural Content Generation in Games: A Textbook and an overview of current researchWhile the field of PCG is mostly based on AI methods, we want to set it apart from the more “mainstream” use of game-based tasks to test AI algorithms, where AI is most often used to learn to play a game.
Categories: FLOSS Project Planets

Sebastien Goasguen: GCE Interface to CloudStack

Fri, 2014-07-11 17:42
Gstack, a GCE compatible interface to CloudStack

Google Compute Engine (GCE) is the Google public cloud. In december 2013, Google announced the General Availability (GA) of GCE. With AWS and Microsoft Azure, it is one of the three leading public clouds in the market. Apache CloudStack now has a brand new GCE compatible interface (Gstack) that lets users use the GCE clients (i.e gcloud and gcutil) to access their CloudStack cloud. This has been made possible through the Google Summer of Code program.

Last summer Ian Duffy, a student from Dublin City University participated in GSoC through the Apache Software Foundation (ASF) and worked on a LDAP plugin to CloudStack. He did such a great job that he finished early and was made an Apache CloudStack committer. Since he was done with his original GSoC project I encouraged him to take on a new one :), he brought in a friend for the ride: Darren Brogan. Both of them worked for fun on the GCE interface to CloudStack and learned Python doing so.

They remained engaged with the CloudStack community and has a third year project worked on an Amazon EC2 interface to CloudStack using what they learned from the GCE interface. They got an A :). Since they loved it so much, Darren applied to the GSoC program and proposed to go back to Gstack, improve it, extend the unittests and make it compatible with the GCE v1 API.

Technically, Gstack is a Python Flask application that provides a REST API compatible with the GCE API and forwards the requests to the corresponding CloudStack API. The source is available on GitHub and the binary is downloadable via PyPi. Let's show you how to use it.

Installation and Configuration of Gstack

You can grab the Gstack binary package from Pypi using pip in one single command.

pip install gstack

Or if you plan to explore the source and work on it, you can Clone the repository and install it by hand. Pull requests are of course welcome.

git clone https://github.com/NOPping/gstack.git
sudo python ./setup.py install

Both of these installation methods will install a gstack and a gstack-configure binary in your path. Before running Gstack you must configure it. To do so run:

gstack-configure

And enter your configuration information when prompted. You will need to specify the host and port where you want gstack to run on, as well as the CloudStack endpoint that you want gstack to forward the requests to. In the example below we use the exoscale cloud:

$ gstack-configure
gstack bind address [0.0.0.0]: localhost
gstack bind port [5000]:
Cloudstack host [localhost]: api.exoscale.ch
Cloudstack port [8080]: 443
Cloudstack protocol [http]: https
Cloudstack path [/client/api]: /compute

The information will be stored in a configuration file available at ~/.gstack/gstack.conf:

$ cat ~/.gstack/gstack.conf
PATH = 'compute/v1/projects/'
GSTACK_BIND_ADDRESS = 'localhost'
GSTACK_PORT = '5000'
CLOUDSTACK_HOST = 'api.exoscale.ch'
CLOUDSTACK_PORT = '443'
CLOUDSTACK_PROTOCOL = 'https'
CLOUDSTACK_PATH = '/compute'

You are now ready to start Gstack in the foreground with:

gstack

That's all there is to running Gstack. To be able to use it as if you were talking to GCE however, you need to use gcutil and configure it a bit.

Using gcutil with Gstack

The current version of Gstack only works with the stand-alone version of gcutil. Do not use the version of gcutil bundled in the Google Cloud SDK. Instead install the 0.14.2 version of gcutil. Gstack comes with a self-signed certificate for the local endpoint gstack/data/server.crt, copy the certificate to the gcutil certificates file gcutil/lib/httplib2/httplib2/cacerts.txt. A bit dirty I know, but that's a work in progress.

At this stage your CloudStack apikey and secretkey need to be entered in the gcutil auth_helper.py file at gcutil/lib/google_compute_engine/gcutil/auth_helper.py.

Again not ideal but hopefully gcutil or the Cloud SDK will soon be able to configure those without touching the source. Darren and Ian opened a feature request with google to pass the client_id and client_secret as options to gcutil, hopefully future release of gcutil will allow us to do so.

Now, create a cached parameters file for gcutil. Assuming you are running gstack on your local machine, using the defaults that were suggested during the configuration phase. Modify ~/.gcutil_params with the following:

--auth_local_webserver
--auth_host_port=9999
--dump_request_response
--authorization_uri_base=https://localhost:5000/oauth2
--ssh_user=root
--fetch_discovery
--auth_host_name=localhost
--api_host=https://localhost:5000/

Warning: Make sure to set the --auth_host_name variable to the same value as GSTACK_BIND_ADDRESS in your ~/.gstack/gstack.conf file. Otherwise you will see certificates errors.

With this setup complete, gcutil will issues requests to the local Flask application, get an OAuth token, issue requests to your CloudStack endpoint and return the response in a GCE compatible format.

Example with exoscale.

You can now start issuing standard gcutil commands. For illustration purposes we use Exoscale. Since there are several semantic differences, you will notice that as a project we use the account information from CloudStack. Hence we pass our email address as the project value.

Let's start by listing the availability zones:

$ gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com listzones
+----------+--------+------------------+
| name | status | next-maintenance |
+----------+--------+------------------+
| ch-gva-2 | UP | None scheduled |
+----------+--------+------------------+

Let's list the machine types or in CloudStack terminology: the compute service offerings and to list the available images.

$ ./gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com listimages
$ gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com listmachinetypes
+-------------+----------+------+-----------+-------------+
| name | zone | cpus | memory-mb | deprecation |
+-------------+----------+------+-----------+-------------+
| Micro | ch-gva-2 | 1 | 512 | |
+-------------+----------+------+-----------+-------------+
| Tiny | ch-gva-2 | 1 | 1024 | |
+-------------+----------+------+-----------+-------------+
| Small | ch-gva-2 | 2 | 2048 | |
+-------------+----------+------+-----------+-------------+
| Medium | ch-gva-2 | 2 | 4096 | |
+-------------+----------+------+-----------+-------------+
| Large | ch-gva-2 | 4 | 8182 | |
+-------------+----------+------+-----------+-------------+
| Extra-large | ch-gva-2 | 4 | 16384 | |
+-------------+----------+------+-----------+-------------+
| Huge | ch-gva-2 | 8 | 32184 | |
+-------------+----------+------+-----------+-------------+

You can also list firewalls which gstack maps to CloudStack security groups. To create a securitygroup, use the firewall commands:

$ ./gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com addfirewall ssh --allowed=tcp:22
$ ./gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com getfirewall ssh

To start an instance you can follow the interactive prompt given by gcutil. You will need to pass the --permit_root_ssh flag, another one of those semantic and access configuration that needs to be ironed out. The interactive prompt will let you choose the machine type and the image that you want, it will then start the instance

$ ./gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com addinstance foobar
Selecting the only available zone: CH-GV2
1: Extra-large Extra-large 16384mb 4cpu
2: Huge Huge 32184mb 8cpu
3: Large Large 8192mb 4cpu
4: Medium Medium 4096mb 2cpu
5: Micro Micro 512mb 1cpu
6: Small Small 2048mb 2cpu
7: Tiny Tiny 1024mb 1cpu
7
1: CentOS 5.5(64-bit) no GUI (KVM)
2: Linux CentOS 6.4 64-bit
3: Linux CentOS 6.4 64-bit
4: Linux CentOS 6.4 64-bit
5: Linux CentOS 6.4 64-bit
6: Linux CentOS 6.4 64-bit
<...snip>
INFO: Waiting for insert of instance . Sleeping for 3s.
INFO: Waiting for insert of instance . Sleeping for 3s.

Table of resources:

+--------+--------------+--------------+----------+---------+
| name | network-ip | external-ip | zone | status |
+--------+--------------+--------------+----------+---------+
| foobar | 185.1.2.3 | 185.1.2.3 | ch-gva-2 | RUNNING |
+--------+--------------+--------------+----------+---------+

Table of operations:

+--------------+--------+--------------------------+----------------+
| name | status | insert-time | operation-type |
+--------------+--------+--------------------------+----------------+
| e4180d83-31d0| DONE | 2014-06-09T10:31:35+0200 | insert |
+--------------+--------+--------------------------+----------------+

You can of course list (with listinstances) and delete instances

$ ./gcutil --cached_flags_file=~/.gcutil_params --project=runseb@gmail.com deleteinstance foobar
Delete instance foobar? [y/n]
y
WARNING: Consider passing '--zone=CH-GV2' to avoid the unnecessary zone lookup which requires extra API calls.
INFO: Waiting for delete of instance . Sleeping for 3s.
+--------------+--------+--------------------------+----------------+
| name | status | insert-time | operation-type |
+--------------+--------+--------------------------+----------------+
| d421168c-4acd| DONE | 2014-06-09T10:34:53+0200 | delete |
+--------------+--------+--------------------------+----------------+

Gstack is still a work in progress, it is now compatible with GCE GA v1.0 API. The few differences in API semantics need to be investigated further and additional API calls need to be supported. However it provides a solid base to start working on hybrid solutions between GCE public cloud and a CloudStack based private cloud.

GSoC has been terrific to Ian and Darren, they both learned how to work with an open source community and ultimately became part of it through their work. They learned tools like JIRA, git, Review Board and became less shy with working publicly on a mailing lists. Their work on Gstack and EC2stack is certainly of high value to CloudStack and should become the base for interesting products that will use hybrid clouds.

Categories: FLOSS Project Planets

Bryan Pendleton: OK, just a little more and then I'll let it go

Thu, 2014-07-10 22:32

I have to admit to at least a bit of sadness that Arjen Robben won't be in the final. I have this weird love/hate relationship with Robben: he is just phenomenally skillful, and he runs like a maniac for the full 90 minutes (I said to a friend: "he's like Michael Bradley, but with the perfect first touch").

But then he channels his inner Leonardo DiCaprio, and I just throw up my arms.

So give me Leo.

Oh, YES, give me Leo!

It would be a much easier call if Angel DiMaria, who gets nowhere near enough credit, could be part of the outcome, but even without him I think the Argentines have a real chance.

Just let me hear no more silky-voiced British commentators telling me about that "well-oiled German machine."

Here's my prediction, and my hope: Argentina 1, Germany 0, in a well-played, well-officiated, thrilling replay of the 1990 matchup, but with a different outcome this time.

Meanwhile, I still don't understand what happened last Tuesday (and Nate Silver doesn't, either!)

I'm not alone:

  • Why Brazil Lost: Rather than make a real plan, they abandoned themselves to romantic notions of passion and desire.Barring the few thousand overjoyed Germans there was an atmosphere of stunned, disbelieving horror in that stadium that has possibly never before been experienced in sport. It was as though Germany had gathered 60,000 4-year-olds together and briskly announced that there is no such thing as Santa Claus.
  • The Most Shocking Result in World Cup HistoryAs I mentioned, however, the Elo system discounts lopsided victories. Since it was the lopsidedness of the scoreline that made Tuesday’s match such an outlier, that somewhat defeats our purpose of placing the result in historical context.
  • Germany 7-1 Brazil: Germany record a historic thrashing, winning the game in 30 minutesThis should be regarded as one of the most historic defeats football as seen: the hosts, pre-tournament favourites and the most successful side in the history of the World Cup humbled 1-7 in their own country, in the semi-final. Everyone is wise after the event, and many will suggest Germany were always likely to win, but in reality, with the bookmakers had Germany and Brazil at exactly the same odds to triumph. This was considered 50:50, and expected to be a tight, tense game...
  • Brazil v Germany: Biggest humiliation in history of Brazilian football as 7-1 thrashing in World Cup signals night the music diedFurther down this week’s road we will turn our thoughts to the brilliance of this Germany side, and how they have shown the rest of the world the right path to youth development. But first there is much more angst to seep out of Brazil. Social equilibrium always appeared dependent on the team’s ability to go on winning games. Scolari’s promise to bestow a sixth world title on his people was meant to calm the nation’s nerves. It reads now like a rhetorical leap off a cliff.
  • Brazil's Worst Nightmare Comes True as Germany Eviscerate World Cup DreamsOver the next 90 minutes, in perhaps the most surprising, jaw-dropping result in World Cup history, Brazil were demolished 7-1 by a rampant Germany side, as a combination of woeful organisation, shoddy defending, individual mistakes and incisive attacking (the Europeans deserve some credit, after all) sent the tournament hosts out of the competition with their tails firmly between their legs.

    This was scarcely believable stuff, even as it happened in front of the world’s eyes. To put it in some type of context, this was Brazil’s first competitive defeat on home soil since 1975—a 3-1 loss to Peru that also happened in Belo Horizonte’s Estadio Mineirao. It was the first time they had conceded four goals since a 4-2 loss to Hungary in the 1954 World Cup.

  • World Cup 2014: Records broken in Germany's 7-1 win over BrazilThe first time Brazil had ever conceded seven goals in a World Cup match. It has only conceded more once in any fixture, an 8-4 loss to Yugoslavia in a friendly in 1934.

Various publications have attempted to frame this in historical terms by comparing events of similar magnitude.

I have one to offer.

It happened in 1940, which was a long time ago (75 years ago!). There are probably very few people alive who remember this game, and certainly it was 25 years before my time (all I knew about Sammy Baugh came from a dog-eared, flimsy paperback book that I used to read at night before I went to bed): 1940 NFL Championship Game

The game was played at Griffith Stadium in Washington, D.C. on December 8, 1940. The Chicago Bears defeated the Washington Redskins, 73–0, the most one-sided victory in NFL history. The game was broadcast on radio by Mutual Broadcasting System, the first NFL title game broadcast nationwide.

...

the Chicago Bears played perfect football for a greater percentage of the official hour than any team before or since. In the championship game, as an underdog to the team which had just beaten them, the Bears made an eleven-touchdown pile and used it as a pedestal to raise the NFL to view in all corners of the country.

It's not a great comparison, because it was just the United States.

The 2014 Brazil-Germany semi-final, my friends, was the most shocking sporting event that has been played in

the entire world

I've really enjoyed this World Cup, and I hope you did, too.

Next week, I promise, I'll get back to All Those Other Things That Matter To Me.

Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-10

Thu, 2014-07-10 18:58
Categories: FLOSS Project Planets

Tim Bish

Thu, 2014-07-10 14:56
This month marks 10 years since Packt embarked on their mission to deliver effective learning and information services to IT professionals. To celebrate this huge milestone, they are offering ALL of their eBooks and Videos at just $10 each for 10 days – this promotion covers every title and you can stock up on as many copies as you like until July 5th.

This would be a great time to pick up a copy of my book 'Instant Apache ActiveMQ Messaging Application Development How-To' for just $10.
Categories: FLOSS Project Planets

Rich Bowen: BAHA, five years on.

Thu, 2014-07-10 09:29

Five years ago, my beloved encouraged me to get a BAHA - Bone Attached Hearing Aid. It's a device that's implanted in my skull which bypasses the usual hearing apparatus and carries sound vibrations directly to the middle ear.

It would not be too much of an exaggeration to say that this tiny device has prrofoundly changed my life.

I've always been an introvert, and social situations make me uncomfortable ... but I say that based on all of those years avoiding them because my deafness made them so very awkward. The elaborate dance of positioning myself correctly relative to speakers so that I could hear out of my right ear, hurrying to be the first to be seated at a dinner so that I can grab the left-most seat, and avoiding multi-speaker conversations because I'm bound to miss most of it, has been going on since I was 12, and it's hard to remember how things were before that.

While I still can't tolerate super-loud settings - which makes most conference social events something of a chore, endured for the all-important networking - the Baha has changed normal conversation from a painful ordeal, preferably to be avoided, into something more normal and routine, where I can, for the most part, understand what is being said, the first time, without needing several increasingly embarrassing repetitions.

There are still scenarios where it's hard to hear. The very loud places, as mentioned above, for one. Also, conversations with many speakers tend to be difficult, but apparently the latest model of Cochlear's product has intelligent selective filtering, as well as noise reduction stuff in it, and perhaps I can upgrade some day for an even better experience.

Being able to hear has made me more confident, more sure of my opinions, more assertive in meetings, and less irritable with soft-spoken people. And far less awkward in social settings.

And I can sit anywhere I want at dinner.

Categories: FLOSS Project Planets

Rich Bowen: RDO on CentOS 7

Thu, 2014-07-10 08:57

With CentOS 7 now available, I quickly put it on my OpenStack demo laptop, and started installing RDO. It mostly just worked, but there were a few roadblocks to circumvent.

As usual, I followed the RDO Quickstart, so I won't duplicate those steps here, in detail, but it goes like:

sudo yum update -y && sudo yum install -y http://rdo.fedorapeople.org/rdo-release.rpm && sudo yum install -y openstack-packstack && packstack --allinone

Comparison of string with 7 failed

The first problem occurs pretty quickly, in prescript.pp, with the following error message:

Comparison of String with 7 failed

This is due to the change in CentOS versioning scheme - the latest release of CentOS is version 7.0.1406, which is not a number. The script in question assumes that the version number is a number, and does a numerical comparison:

if $::operatingsystem in $el_releases and $::operatingsystemrelease 7 { ...

This fails, because $::operatingsystemrelease is a string, not a number.

The solution here is to edit the file /usr/lib/python2.7/site-packages/packstack/puppet/templates/prescript.pp and replace the variable $::operatingsystemrelease with $::operatingsystemmajrelease around line 15.

While you're at it, do this for every file in that directory, where $operatingsystemrelease is compared to 7.

See https://bugzilla.redhat.com/show_bug.cgi?id=1117035 for more detail, and to track when this is fixed.

mysql vs mariadb

The second problem, I'm not sure I understand just yet. The symptom is that mysql.pp fails with

Error: Could not enable mysqld:

To skip to the end of the story, this appears to be related to the switch from mysql to mariadb about a year ago, finally catching up with CentOS. The related bug is at https://bugzilla.redhat.com/show_bug.cgi?id=981116

The workaround that I used was:

# rm /usr/lib/systemd/system/mysqld.service # cp /usr/lib/systemd/system/mariadb.service /usr/lib/systemd/system/mysqld.service # systemctl stop mariadb # pkill mysql # rm -f /var/lib/mysql/mysql.sock

Then run packstack again with the generated answer file from the last time.

However, elsewhere in the thread, we were assured that this shouldn't be necessary, so YMMV. See https://www.redhat.com/archives/rdo-list/2014-July/msg00055.html for further discussion.

That's all, folks

After those two workarounds, packstack completed successfully, and I have a working allinone install.

Hope this was helpful to someone.

UPDATE: The next time through, I encountered https://ask.openstack.org/en/question/35705/attempt-of-rdo-aio-install-icehouse-on-centos-7/

The workaround is to replace contents of /etc/redhat-release with "Fedora release 20 (Heisenbug)" and rerun packstack.

Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-09

Wed, 2014-07-09 18:58
  • Google’s Influential Papers for 2013

    Googlers across the company actively engage with the scientific community by publishing technical papers, contributing open-source packages, working on standards, introducing new APIs and tools, giving talks and presentations, participating in ongoing technical debates, and much more. Our publications offer technical and algorithmic advances, feature aspects we learn as we develop novel products and services, and shed light on some of the technical challenges we face at Google. Below are some of the especially influential papers co-authored by Googlers in 2013.

    (tags: google papers toread reading 2013 scalability machine-learning algorithms)

Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-08

Tue, 2014-07-08 18:58
  • #BPjMleak

    ‘Leak of the secret German Internet Censorship URL blacklist BPjM-Modul’. Turns out there’s a blocklist of adult-only or prohibited domains issued by a German government department, The Federal Department for Media Harmful to Young Persons (German: “Bundesprüfstelle für jugendgefährdende Medien” or BPjM), issued in the form of a list of hashes of those domains. These were extracted from an AVM router, then the hashes were brute forced using several other plaintext URL blocklists and domain lists. Needless to say, there’s an assortment of silly false positives, such as the listing of the website for the 1997 3D Realms game “Shadow Warrior”: http://en.wikipedia.org/wiki/Shadow_Warrior

    (tags: hashes reversing reverse-engineering germany german bpjm filtering blocklists blacklists avm domains censorship fps)

  • Brave Men Take Paternity Leave – Gretchen Gavett – Harvard Business Review

    The use of paternity leave has a “snowball effect”:

    In the end, Dahl says, “coworkers and brothers who were linked to a father who had his child immediately after the [Norwegian paid paternity leave] reform — versus immediately before the reform — were 3.5% and 4.7% more likely, respectively, to take parental leave.” But when a coworker actually takes parental leave, “the next coworker to have a child at his workplace is 11% more likely to take paternity leave.” Slightly more pronounced, the next brother to have a child is 15% more likely to take time off. And while any male coworker taking leave can reduce stigma, the effect of a manager doing so is more profound. Specifically, “the estimated peer effect is over two and a half times larger if the peer father is predicted to be a manager in the firm as opposed to a regular coworker.”

    (tags: paternity-leave parenting leave work norway research)

  • “The Tail at Scale”

    by Jeffrey Dean and Luiz Andre Barroso, Google. A selection of Google’s architectural mechanisms used to defeat 99th-percentile latency spikes: hedged requests, tied requests, micro-partitioning, selective replication, latency-induced probation, canary requests.

    (tags: google architecture distcomp soa http partitioning replication latency 99th-percentile canary-requests hedged-requests)

Categories: FLOSS Project Planets

Bryan Pendleton: Brazil vs. Germany

Tue, 2014-07-08 15:33

I am dumbfounded.

The world is dumbfounded.

This will be discussed for MANY a year.

Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-07

Mon, 2014-07-07 18:58
Categories: FLOSS Project Planets

Matthias Wessendorf: UnifiedPush Server 0.11 is out!

Mon, 2014-07-07 04:07

Today we are extremely happy to announce an all new AeroGear UnifiedPush Server!

The UnifiedPush Server comes with a completely rewritten Angular.js based UI and is now powered by Keycloak! Thanks to the Keycloak team for the great work they delivered helping the AeroGear team to make the Keycloak integration happen.

Getting started

Getting started w/ the new server is still very simple:

  • Setup a database (here is an example for the H2 Database engine. Copy into $JBOSS/standalone/deployments)
  • Download the two WAR files (core and auth) and copy into $JBOSS/standalone/deployments
  • Start the JBoss server

The 0.11.0 release contains a lot of new features, here is a more detailed list:

  • Keycloak Integration for user management
  • Angular.js based AdminUI
  • Metrics and Dashboard for some Analytics around Push Messages
  • Code snippet UI now supports Swift
  • and a lot of fixes and other improvements! See JIRA for all the items

Besides the improvements on the server, we also have some Quickstarts to help you get going with the Push Server

Hello World

The HelloWorld is a set of simple clients that show how to register a device with the UnifiedPush Server. On the Admin UI of the server you can use the “Send Push” menu to send a message to the different applications, running on your phone.

Mobile Contacts Quickstart

The Mobile Contacts Quickstart is a Push-enabled CRUD example, containing several client applications (Android, Apache Corodva and iOS) and a JavaEE-based backend. The backend app is a secured (Picketlink) JAX-RS application which sends out push messages when a new contact has been created. Sometimes the backend (for a mobile application) has to run behind the firewall. For that the quickstart contains a Fabric8 based Proxy server as well.

Thanks again to the Keycloak team for their assistance.

Now, get your hands dirty and send some push messages! We hope you like the new server!

Next ?

We are now polishing the server for the 1.0.0 push release this summer. See the roadmap for details.


Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-06

Sun, 2014-07-06 18:58
  • Layered Glass Table Concept Creates a Cross-Section of the Ocean

    beautiful stuff — and a snip at only UKP 5,800 ex VAT. it’d make a good DIY project though ;)

    (tags: art tables glass layering 3d cross-sections water ocean sea mapping cartography layers this-is-colossal design furniture)

  • Two traps in iostat: %util and svctm

    Marc Brooker:

    As a measure of general IO busyness %util is fairly handy, but as an indication of how much the system is doing compared to what it can do, it’s terrible. Iostat’s svctm has even fewer redeeming strengths. It’s just extremely misleading for most modern storage systems and workloads. Both of these fields are likely to mislead more than inform on modern SSD-based storage systems, and their use should be treated with extreme care.

    (tags: ioutil iostat svctm ops ssd disks hardware metrics stats linux)

  • New AWS Web Services region: eu-central-1 (soon)

    Iiiinteresting. Sounds like new anti-NSA-snooping privacy laws will be driving a lot of new mini-regions in AWS. Hope Amazon have their new-region-standup process a little more streamlined by now than when I was there ;)

    (tags: aws germany privacy ec2 eu-central-1 nsa snooping)

  • How A Spam Newsletter Caused a Bank Run in Bulgaria

    According to the Bulgarian National Security Agency (see here, for a reporting in English), an investment company that “built a network of associated companies for marketing services” that was used to diffuse panic by means of an alert, uncomfortably titled “Information Bulletin of on the Risk of Deposits in Bulgarian Banks”. The “bulletin” claimed – Bloomberg reports – KTB was undergoing a liquidity shortage. The message apparently also said that the government deposit guarantee fund was under-capitalised to meet possible repayments, that banks could go bankrupt and that the peg of the currency with the euro could be broken. Allegedly, the alert was diffused by text, email and even Facebook messages, thus ensuring a very widespread outreach. In a country that in 1997 underwent a very serious banking crisis featuring all these characteristics – whose memory is still fresh – this was enough to spur panic.

    (tags: spam banking bulgaria banks euro panic facebook social-media)

  • New Russian Law To Forbid Storing Russians’ Data Outside the Country – Slashdot

    On Friday Russia’s parliament passed a law “which bans online businesses from storing personal data of Russian citizens on servers located abroad[.] … According to ITAR-TASS, the changes to existing legislation will come into effect in September 2016, and apply to email services, social networks and search engines, including the likes of Facebook and Google. Domain names or net addresses not complying with regulations will be put on a blacklist maintained by Roskomnadzor (the Federal Supervision Agency for Information Technologies and Communications), the organisation which already has the powers to take down websites suspected of copyright infringement without a court order. In the case of non-compliance, Roskomnadzor will be able to impose ‘sanctions,’ and even instruct local Internet Service Providers (ISPs) to cut off access to the offending resource.”

    (tags: russia privacy nsa censorship protectionism internet web)

Categories: FLOSS Project Planets

Bryan Pendleton: Los Ticos estan terminados

Sat, 2014-07-05 17:52

Sigh.

My favorite scrappy little underdogs have finally met their match, and Costa Rica's amazing World Cup run is over.

What fun they were to watch, though!

Giant killers to the last, bowing to nobody, they made every minute entertaining.

Thank you, Los Ticos, for a most enjoyable and gritty performance, and may there be many more in your future.

Categories: FLOSS Project Planets

Bryan Pendleton: The Devil I Know: a very short review

Sat, 2014-07-05 12:33

I've been reading all sorts of books about Ireland recently, some of them superb, some of them dreadful.

Claire Kilroy's The Devil I Know falls solidly into the superb category.

This is a book that entertains and delights on multiple levels.

Straightforwardly, it is a tale of a financiers and real-estate developers in Ireland during the great real estate speculation that preceded the credit crash of 2008. Together, Tristram St. Lawrence and Desmond Hickey purchase land for redevelopment:

He drove in the direction of the castle but pulled in at the old cement factory, which was located a few hundred yards shy of my gateposts and on the other side of the road. Only in Ireland would the acreage flanking a white sand beach be zoned for industrial use.

...

'this is me next project. I'm developing it for residential an commercial use.' He pointed out through the passenger window. 'There'll be an apartment block here,' we rolled along, 'an another here, an two over there. Eight blocks in total, ranging in height from three to eight storeys. We're looking at the guts of 400 residential units, with about 12,000 square metres of office an commercial space at ground level, to include a hotel.'

The tale of the chaos, ecstasy, and frenzy of those days is marvelously handled. Kilroy's light touch spirits us along through the absurdity of it all:

'You can't build an apartment complex in Ireland without a hotel.'

'Don't be ridiculous. Of course you can.'

'Ah see,' he said, 'you can an you can't. No investor will touch you unless you qualify for Section 23-type reliefs.'

'Section 23?'

'Tax write-offs. So we have to build either a hotel or a multi-storey car park or a hospital or a student residence. None a which are needed, but the way I see it, if you build a hotel, then at least you have a bar.'

At a slightly deeper level, The Devil I Know is about the power of greed and the tenacity of addiction. Tristram is an alcoholic, struggling with his addiction:

Engine rise, engine fall, engine rise, engine fall as Hickey turned memories over in his head. He swilled back another snifter and smiled at some recollection. Ahhhhh. He had entered the first stage of inebriation, which is perfect, just perfect: it is heaven. That mellow, impeccable stage when nothing can harm you. The log fire is crackling away on the inside and you are safe in your warm little snug. I'd have given my right arm to feel that way again. But I couldn't give my life. But now Tristram is struggling with a new addiction as well. My name, the zeros, my name, the zeros -- my eyes cranked up their shuttling. Money disrupts the cognitive process. It gums electrodes to your skull and scrambles your brain. That document was a test, I see now, of my character. A test I failed. Tristram St Lawrence I wrote at the bottom of the page. Everyone has a price.

As it turns out, as Kilroy observes, as Tristram sees as he enters this new phase of his life, he's not the only one struggling with this new addiction. The entire world, it seems, is on the verge of succumbing:

I looked at him. He believed it. All of them around the boardroom table had believed it too. They believed that the land had changed, and that they, the Golden Circle, were the agents of this change, that somehow, by linking hands around a table, or through the appliance of their balls, they had managed to perform alchemy upon Irish soil. Hickey grinned as he contemplated the open road stretching before us. Every light ahead had turned to green.

At yet a deeper level, something more mystical and meaningful is going on. This story is populated by angels and demons, by the living but also by the dead, by visions, by puzzles, by riddles. There are exultations of the highest joy, and there are nightmares of the deepest horror. What is real, what is fantasy?

To some extent, Kilroy is playing and dancing and spinning a tale, but at another level I think she is drawing a parallel, a metaphor. Real estate speculation requires a certain suspension of disbelief: you have to see a house where there isn't one; you have to see a family where only dirt exists; you have to see an alternate future instead of an old cement factory. This listening to the voices and visions in your head might be delusional and insane, but on the other hand it might be the creative process at work. Where is the line?

In the end, I think Kilroy sees herself as an observer, a journalist, a recorder of a strange time, a bizarre occurrence that came and went, and perhaps we will never come to understand it.

The historian squinted at the setting sun. I was stricken by an overwhelming sense of things coming to an end, of the torch being passed on, or not passed on, just extinguished. 'It's getting late,' he told me, barely telling me at all. 'It is time to leave the garden.'

I found myself at a loss and looked around frantically. Quite what I was searching for, exactly, I still do not know, and I possibly never will know, but I felt certain that I was forgetting something, that I was leaving some critical belonging behind, some vital possession without which everything, everything, everything would go awry. I appealed to the historian. 'Now, you mean?' I asked him, panic surging up my through. Doom, doom went my heart. 'Do you mean we're leaving now?'

'Yes, now, I'm afraid.'

I was afraid too. Afraid and unprepared. I glanced up. The sky was rapidly dimming.

He guided me to the exit -- or was it the entrance, and if so, the entrance to what? -- and he extended a crooked hand when we reached the crooked stile.

I, too, don't know what this is the entrance to, but I'm entranced to let Kilroy guide me there.

Kilroy is a wonderfully fluid, gifted, and skilled writer. Her writing is trememdously literate, weaving in references to Joyce, Faust, Shakespeare, the Bible and so much more. But her story is never ponderous and sluggish. The book was a joy to read.

If you're looking for a fun summer read, put Claire Kilroy's The Devil I Know on your list.

Categories: FLOSS Project Planets

Justin Mason: Links for 2014-07-04

Fri, 2014-07-04 18:58
  • Irish parliament pressing ahead with increased access to retained telecoms data

    While much of the new bill is concerned with the dissolution of the Competition Authority and the National Consumer Agency and the formation of a new merged Competition and Consumer Protection Commission (CCPC) the new bill also proposed to extend the powers of the new CCPC to help it investigate serious anticompetitive behaviour. Strikingly the new bill proposes to give members of the CCPC the power to access data retained under the Communications (Retention of Data) Act 2011. As readers will recall this act implements Directive 2006/24/EC which obliges telecommunications companies to archive traffic and location data for a period of up to two years to facilitate the investigation of serious crime. Ireland chose to implement the maximum two year retention period and provided access to An Garda Siochana, The Defence Forces and the Revenue Commissioners. The current reform of Irish competition law now proposes to extend data access powers to the members of the CCPC for the purposes of investigating cartel offences.

    (tags: data-retention privacy surveillance competition ccpc ireland law dri)

  • NSA: Linux Journal is an “extremist forum” and its readers get flagged for extra surveillance

    DasErste.de has published the relevant XKEYSCORE source code, and if you look closely at the rule definitions, you will see linuxjournal.com/content/linux* listed alongside Tails and Tor. According to an article on DasErste.de, the NSA considers Linux Journal an “extremist forum”. This means that merely looking for any Linux content on Linux Journal, not just content about anonymizing software or encryption, is considered suspicious and means your Internet traffic may be stored indefinitely. This is, sadly, entirely predictable — that’s what happens when you optimize the system for over-sampling, with poor oversight.

    (tags: false-positives linuxjournal linux terrorism tor tails nsa surveillance snooping xkeyscore selectors oversight)

  • stout

    a C++ library adding some modern language features like Option, Try, Stopwatch, and other Guava-ish things (via @cscotta)

    (tags: c++ library stout option try guava coding)

Categories: FLOSS Project Planets

Bryan Pendleton: Quarterfinals weekend

Fri, 2014-07-04 10:18

Before we, grudgingly, turn our attention to other things, one last survey of things you might have missed:

  • Lionel Messi Is ImpossibleBy now I’ve studied nearly every aspect of Messi’s game, down to a touch-by-touch level: his shooting and scoring production; where he shoots from; how often he sets up his own shots; what kind of kicks he uses to make those shots; his ability to take on defenders; how accurate his passes are; the kind of passes he makes; how often he creates scoring chances; how often those chances lead to goals; even how his defensive playmaking compares to other high-volume shooters.

    And that’s just the stuff that made it into this article. I arrived at a conclusion that I wasn’t really expecting or prepared for: Lionel Messi is impossible.

    It’s not possible to shoot more efficiently from outside the penalty area than many players shoot inside it. It’s not possible to lead the world in weak-kick goals and long-range goals. It’s not possible to score on unassisted plays as well as the best players in the world score on assisted ones. It’s not possible to lead the world’s forwards both in taking on defenders and in dishing the ball to others. And it’s certainly not possible to do most of these things by insanely wide margins.

  • Who Was Dent McSkimming?: The truth behind the legend of the lone American reporter at the 1950 World Cup.But what about those two uncredited stories? Newspaper byline rules could be stringent and arbitrary, and these were different times. Maybe the Post-Dispatch withheld credit from McSkimming because he was on vacation. Maybe the stories were too short to merit a byline. But McSkimming had joined the paper in 1922. Wouldn’t he have wanted credit for his work, and wouldn’t the paper have wanted to showcase the fact that its star soccer writer was on the scene?
  • Belgium 2-1 USA: Belgium dominate but take ages to make the breakthroughThen came an inspired USA fightback. Substitute Julian Green, on for Bedoya, scored a consolation goal and his side rallied. Those final 13 minutes were extremely impressive, with the goal seemingly giving the USA another gear and simultaneously making Belgium even more tired.

    Bradley, Jones and Cameron, so frustrating in the first half because of their collective insistence on running high up the pitch and leaving space in behind, were now perfect for the situation – a desperate fightback. Witsel and Marouane Fellaini looked exhausted, and Wilmots’ refusal to bring on another midfielder, or even strengthen his defence, was remarkable. He left his side open to constant attacks, and few other sides have exited the competition with such an impressive late rally as this from the United States.

  • Walking to Stay One Step Ahead: Lionel Messi has figured out how to win matches by moving less than everyone else.Of course, if three or four Swiss players were watching Messi, it means that there was space elsewhere on the pitch for Argentina to exploit. But Argentina had not exploited that space, because it seemed that all 10 of their players were watching Messi, too. All of their attacking play was directed through the No. 10, to the exclusion of any other ideas. Every time we recover the ball we try to pass to him, as he is the best player we have in the team and he will score goals.
  • MLS Salaries Released, High Level There's no question that MLS went out to buy as many US National Team players as they could last year. The reasoning behind it is simple; Bring the hordes of USMNT supporters that pack international events over to MLS. Jury is out on this reasoning. Michael Bradley, one of the new signings that's making more than all but four whole teams, played in front of just 12k fans at Crew Stadium last week.
  • MLS Salary Breakdown of the USMNTSix figure salaries among USMNT players, even historically is not rare. Going back to 2006, each World Cup squad has only had one MLS player making under the six figure mark: Robbie Findley in 2010, and Clint Dempsey in 2006 before he left for England.
  • Does The Successful Economics Of MLS Portend Doom For The USMNT?As the league gets stable, there's some risk that American stars will have to choose between getting guaranteed starts in a country they know well for the same kind of money they would make in a foreign land where they might not prosper. For the leading soccer leagues - England, Germany, Italy, Spain - the interest in national team players staying at home is not so important for the health of the national team, as those players that do stay home (and this includes the vast majority of them) face elite competition when they play for their native clubs. For countries with only okay, but well-heeled leagues - Mexico, Russia, and now, maybe, the United States - the fact that the best players can make the best money if they stay at home arguably retards progression, rather than encouraging it.
Categories: FLOSS Project Planets