To work with Apache Hbase and django as backend , we need to use Happybase python library to connect with Hbase .
HappyBase is a developer-friendly Python library to interact with Apache HBase.
HappyBase is designed for use in standard HBase setups, and offers application developers a Pythonic API to interact with HBase.
HappyBase uses the Python Thrift library to connect to HBase using its Thrift gateway.
Below is a sample django project example to work with Hbase
Install below requirements :-
happybase==1.2.0
Django==3.0.3
Create a django project .
# HBase settings
HBASE_HOST = 'localhost'
HBASE_TABLE = 'test_table
#Views starts here
import json
import logging
import random
import threading
from django.conf import settings
from django.http import HttpResponse
import happybase
# Initialization
N_KEYS = 10000
pool = happybase.ConnectionPool(
size=3,host=settings.HBASE_HOST)
def populate_table():
with pool.connection() as connection:
connection.delete_table(settings.HBASE_TABLE, disable=True)
connection.create_table(
settings.HBASE_TABLE,
families={'cf': {}}
)
table = connection.table(settings.HBASE_TABLE)
with table.batch() as b:
for i in xrange(N_KEYS):
row_data = {'cf:col1': 'value-%d' % i}
b.put('row-key-%d' % i, row_data)
if not settings.HBASE_TABLE in connection.tables():
populate_table()
# Views , index will return the hbase data as json response and django with render the data as # httpresponse.
def index(request):
start = 'row-key-%d' % random.randint(0, N_KEYS)
scan = table.scan(row_start=start, limit=4)
output = list(scan)
if 'use-after-return' in request.GET:
# XXX: It is an error to use the connection after it was
# returned to the pool. The next line introduces a race
# condition and may cause random errors when used in
# a multi-threaded environment!
connection.tables()
logger.debug('Request from thread %s', threading.current_thread().name)
return HttpResponse(
json.dumps(output),
content_type='application/json')
If we want we can modify and render the data to our preferred specific html templates and display the data using django template language (Jinja).
Urls.py:-
from django.conf.urls import patterns, include, url
# Uncomment the next two lines to enable the admin:
# from django.contrib import admin
# admin.autodiscover()
urlpatterns = patterns('',
url(r'^$', 'myproj.views.index', name='index'),
# Examples:
# url(r'^$', 'myproj.views.home', name='home'),
# url(r'^myproj/', include('myproj.foo.urls')),
# Uncomment the admin/doc line below to enable admin documentation:
# url(r'^admin/doc/', include('django.contrib.admindocs.urls')),
# Uncomment the next line to enable the admin:
# url(r'^admin/', include(admin.site.urls)),
Hence our sample webapp is ready and we can view the hbase data with own web application .
Choose Background