With the dawning of “Big Data” and Analytics, we as Software Engineers and Developers need to, more than ever, efficiently utilize all computing resources, both hardware and software, in order for our applications to optimally harvest and process such data.
This XPages Insights into Big Data OpenNTF project contains a “Phase 1” sample application that demonstrates two things:
– A simple data partitioning pattern to enable “Big Data” scalability (potentially TeraBytes ++). Achieved via a Managed Bean routing layer within a data-less XPages “dashboard” application.
– Multi-database parallel searching across a large data-set. When a search is requested within the UI, a multi-threaded concurrent search is carried out across twenty-six different databases before providing a seamless search result back to the end-user.