Questions
How system store all events (data input) ?
Sensors (data publishers / data collectors / data crawlers): Netty, PhantomJS, Chrome Ext
Message (Persistent Queue) : Kafka
Decode message into stimulus (aka event), fast persistent to Redis http://redis.io/:
Store stimulus (aka event) in Hadoop in date format yyyy/mm/dd/hh
Indexing with Elasticsearch (all fields in an event)
How system react to data ?
Reactive processing to every stimulus (stimuli as plural)
every event must belongs to category
How system query data ?
FQL (functor query language)
translate FQL to ES http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-query-string-query.html
English to FQL converter
