text:
Women Crush Wednesday Featuring: Hilary Saunders, Xoller, Kara Connolly, Savannah Sgro,
Hilary Saunders " Temporary "
Hailing from the state of Nebraska, Hilary Saunders is a singer-songwriter who is an accomplished acoustic guitar player and also a drummer. She has produced three previous records and on her newest single Temporary her strong vocals give us hints to her Midwestern upbringing.
Xoller " Warning Shot "
Xoller's new solo single Warning Shot ( she is also part of NY Dreamwave duo PROM ) is a song about the love we feel when we're hopelessly addicted to something and it is never what we expected it to be. Warning Shot is a wistful tune that carries you softly through the end with dreamy vocals and a soaring chorus. Look for her debut EP Diamond In My Head coming sometime this spring.
Kara Connolly " Other People "
We have all been there, you break up with someone or they break up with you and then the strangeness of the thought that they are existing out in the world without you. That is what Kara Connolly's new single Other People is about. The single is lighthearted and upbeat and fun to listen to. Connolly's upcoming LP Life In Rear View is a unique genre-bending blend of percussive pop, folk, and country and takes you on a journey from breakdown to breakthrough.
Savannah Sgro " Moody "
Nashville based singer-songwriter Savannah Sgro newest single, Moody deals with the ups and downs of dealing with mood swings, a very relatable storyline for many of us. Sgro's dreamy vocals, well-written lyrics, and catchy chorus had us singing along after first listen.


text:
Old Problems, New Solutions | ThinkAdvisor by Laurie Belew
More conversations within the financial planning profession are centered on the now widely publicized demographics of financial advisors themselves. The impending retirement of boomer advisors has left many concerned about a potential talent shortage. How do we, as advisors, business-owners and even as a profession, ensure that financial advice remains available for those who need it? Topics such as building career paths, attracting young talent and creating sustainable businesses through succession planning now dominate most practice management conversations in the profession.
These are not new conversations.

subset: commoncrawl


text:
I just put in three taps, my son will help with the others tomorrow, all in trees I have tapped before. In the second tree, I believe I hit bad wood. The shavings had clean white, "good" wood, mixed with a browner, almost splintered look. Sorry the pic isn't great. The two other trees began running immediate. This one did not, which I know doesn't necessarily mean anything. All set back from my drive, but are the first trees in the woods, so have more sun exposure. The tree which this came from is large and can definitely support 2 taps.
So the question is, is this in fact bad wood? If so, should I pull the tap? If so, am I good to go ahead and tap in another location on this tree since it could support 2? And presumably, if I do, and the next tap also is bad wood, I shouldn't put anything else in.
Thanks for the help.


text:
"Tell me something I don't know."
You're probably aware that cloud computing is good for business. But why? All you hear are the clichés, like "The cloud will save you time and money" and "increase productivity", when questioning the benefits of cloud computing. And you think, 'Is that all you got, wise guy?'
So, how does moving to the cloud really help your business?
If you're going to undertake the considerable effort required to switch your systems, databases, and apps over to a remote platform in the cloud, you need more than just sound bites.
Here are 10 meaningful ways cloud computing can be a difference-maker for Columbus, OH-area businesses.
1. The Cloud is the Only Answer to Tech's Biggest Weakness
All this ever-growing technology has created is one huge problem: Making it all work together, especially at the platform level. What's that mean? Programs, CRMs, and apps that work on your computer don't automatically work on mobile devices or tablets. They need new and different functionality. It's more than just a different screen size.
Only a platform-based service, therefore, can overcome that. That's what cloud computing is, in a nutshell – a platform level service (PaaS – Platform as a Service) that integrates your business applications, data, and systems across all devices.
This means your customers and staff can do what they need to do, wherever they need to do it, and on whatever device they have at hand.
2. Keeps Your Staff Close, and your Customers Closer
Customer loyalty is the heartbeat of a growing business. You can't sustain a business only on new customers.
But people have little patience for confusing technology. If I've gone through the trouble of filling all my information in to buy something, and, suddenly, the item is out of stock, or a system error kicks me out, or I need a password I didn't know about, or dozens of other system-level issues that can interfere with me sending you my money – I'll quit, and you'll lose.
Even your most loyal customers won't tolerate this kind of process too many times. The cloud keeps your information systems working and talking to each other to reduce technology-based errors. That means loyalty. And loyalty means profit.
3. Faster App Development and Deployment
More businesses are currently creating apps to help their customers engage with them, allowing functionality on mobile infrastructure. But app development is time-consuming. The thing is, most of that time doesn't get spent on the design or the user experience. Most of it goes into security features, back-end coding, and various requirements your customers know nothing about.
Cloud computing takes most of this process off your hands. You can focus on the front end parts of your app, but leave all the backend configuration to your cloud service. That means your apps are up and running much faster – giving you the competitive edge.
4. Keeps Your Documents Within the 'Family'
Centralized document storage, and the ability to access them from anywhere to make changes everyone can see, is one of the best efficiency savers of the cloud. Google docs is the most well-known example of this. But any business using cloud computing can create or access tools like this.
No more emailing documents back and forth, or having to save big video or image files on network servers (or individual computers). It's all in one place, off-site, and easy to reach.
5. Integration Avoids Costly Upgrades
Upgrading your software, hardware, CRM, applications, and basically any tech-related asset costs money. Re-integrating those systems after upgrading costs more. Cloud computing reduces all these costs because upgrades happen automatically, and integration is maintained off-site.
6. Re-focuses Your Staff on Growth, Not Maintenance
The amount of time wasted just maintaining a bunch of disconnected, unrelated, aging, cranky software and hardware systems drains the life from your business. The cloud allows you to focus your attention on your business because you don't have to flush your time down the toilet making all your technology get along. Someone else does it for you, and most of it is automated.
7. Disaster Recovery Made Simple (as much as possible)
Waking up with a horse's head in your bed feels about the same as walking into work and finding out you've been victimized by a cyberattack or that your data got lost in a natural disaster or a technical glitch. It's panic time.
But if all your data and systems are backed up and functioning in cloud-based off-site locations, you can rest easy. All your valuable tech assets are secure. The cloud makes disaster recovery much simpler compared to all your technology present on business premised. And the horse gets to live.
8. Automatic Software Updates
Imagine never having to buy software again because it continually updates. That's what cloud computing has made possible. More and more software companies are taking advantage of it. And you should too.
9. No Expensive On-Site Equipment to Buy
Big technology expenses can, for the most part, become a thing of the past with cloud computing. You won't need big servers anymore, or all the other infrastructure that goes with them. That takes a major load off your budget and your staff.
10. Innovate Faster – Stay Ahead of the Competition
One of the biggest challenges for businesses is any sort of change. This is especially true with technology. A fully working cloud computing system makes innovation and the market differentiation that comes with it faster and easier.
If you launch a new product, your technology can integrate it across all your systems much faster in the cloud than if you have a bunch of island systems for marketing, sales, accounting, customer interfaces, HR, billing, and all the rest.
With your systems and data integrating and operating out of the cloud, you can get back to working on your business – keeping up with your loyal customers, and reaching out to new ones. And you'll be able to sleep peacefully every night (but hopefully not with the fishes).


text:
We thank the writers for their letters ("Pay heed to cyber bullying among youth" by Ms Teo Leng Lee ; last Friday and "Don't let 'get tough on bullying' be mere slogan" by Mr Ng Qi Siang; last Thursday, as well as "Untangling the issues underlying bullying" by Mr Leon Koh Wee Kiat, last Thursday, and "Empower teachers to better deal with bullying" by Ms Maria Loh Mun Foong, last Wednesday; both published in Forum Online).
The Ministry of Education (MOE) and our schools are committed to high standards of discipline.
We do not tolerate bullying in any form, and schools have in place a system and measures to support a safe, conducive learning environment.
Schools will take action to investigate all reported cases.
Appropriate disciplinary actions will be taken against students who commit the act of bullying.
Schools also help all students involved learn from the incident.
In cases where a student does not respond to remediation such as counselling, other disciplinary actions such as caning and suspension will be taken.
Schools will also inform and engage parents to get their support to counsel their children.
Teachers are equipped with relevant knowledge and skills through classroom management training where case studies and specific intervention strategies are discussed.
Such training is core in all teacher preparation programmes.
Teachers have the responsibility to maintain discipline in the classrooms and deal with bullying.
They are further supported by their heads of department, year heads, school leaders and school counsellors.
Students may from time to time make mistakes in the process of growing up.
Schools will teach, educate, discipline and counsel them with the goal of enabling them to learn from their mistakes, and support them as they strive to become better persons.
These students also need the support of parents and the community.
Our schools educate students on bullying through formal curriculum and school-based programmes.
Students are taught help-seeking skills, how to manage themselves and build good relationships with others.
Students are also taught that they have the responsibility as bystanders to speak up and support their peers who are bullied.
Despite the teachers' best efforts, not every case of bullying can be identified, and action can only be taken when the case is reported.
Parents can help by alerting the school when they notice something amiss in their child's behaviour at home.
On the bullying case in Shuqun Secondary School, the school has disciplined and counselled the students involved, met their parents, and spoken to the class to help all parties reconcile.
The boys need space away from the public glare to move on. The school and parents are working together to support them.
Low Khah Gek (Ms)
Deputy Director-General of Education (Schools) and Director of Schools
Ministry of Education


text:
DNALive24 : Health
No one can deny the fact that the Church in India is as old as Christianity itself. Christianity in India grew within the socio-cultural contexts of India. It is rooted in the Indian culture and traditions. In India, down through the centuries, the Church continued her healing mission, especially through faith, Word and sacraments. Church in India is also very aware of the need of health care in India. In the long process of healing ministry, many have tried to integrate Indian healing techniques into the Christian healing ministry. Today, many are aware of the need for inculturation. It has become a landmark of union between people and religions. It is in the line of inculturation we speak of an integral view of yoga and Christian healing. Hence we speak of adaptation which can enrich our Christian living. Today, there is a great demand for yoga; especially people in the West tend to discover its importance. At the same time, when we integrate yoga into Christian life, we must be careful too. The Church says that most often Christians are attracted to yoga because of its therapeutic reason. However, we need to accept the fact that yoga can help us to achieve holistic health and it is a spiritual discipline that can be applied by anyone. Moreover, today, many find common features in Christian spirituality and yoga spirituality.
Health has a social finality. It means that in the society, we need the cooperation and interdependence of people in the field of health care. We have a responsible duty towards our neighbours well-being. Everybody can play a vital role in bringing wholeness and health to all humanity. Social responsibility appeals to everyones ability and generosity to serve the fundamental social groups of family and society. In the society, we all work together to meet physical and mental needs of the people. Hence everybody has their own part to contribute to society. Therefore, we have a task to bring wholeness to the people of our society. Hence, it attests to the cooperation and inter-dependence of people in the fields of nourishment, housing care, etc. Therefore, it demands a social responsibility.
Health is both an individual and social good. We need to know that bodily life is a gift of God. In the Holy Scripture the long life is considered as a blessing. With long life I will satisfy them (Ps 91: 16). However, everyone has got a personal responsibility that life is given to man not at his will but in stewardship. Therefore, bodily life and health are good entrusted to man by God. Hence man has a personal responsibility to take care of his health. It is the responsibility of every human person to strive for holistic health. Dr. Elson Haas recommends certain ways to holistic health. He gives certain practical advices regarding proper in taking of nutritious food to nourish ones health. He also advises a balanced diet of wholesome natural foods and highlights the needs for drinking the good water to keep one healthy. Moreover, one has to exercise regularly, sleep well and relax. Moreover, one needs to love oneself and love others. Hence it is ones personal responsibility to keep oneself healthy.


text:
Python and Django full stack Web Developer Bootcamp
Web developing isn't as hard as people initially think of. Want to start your career as a full-stack web developer? Web developing isn't as hard as people initially think of. I'm sure you probably know what web developing is by this point of time and if you don't then let me explain it to you in a single line. It's the process through which a person designs a website or a string of websites. There are many different types of coding languages around just like our real-life world. Each with their advantages and facilities. Even though they are conceived to be the same but during the application of the language the difference seems to pop up quite significantly. In today's article, I'm going to explain to you why I believe python and Django to be the best coding language and framework around, why you should learn it, What will the future opportunities look like and why Python and Django full stack web developer Bootcamp is the best medium to learn python. So, without further disruption lets go forward to find out how you are going to learn Python and Django development!
Addressing the problems
Before going into the article, we need to talk about a small issue first. The one where most of the people say I've got better things to do or I don't have the time to learn stuff now. Even if someone overcomes all those hurdles they are hit with the fear of "I have no prior experience isn't it going to hamper my progress as a developer?" I'm going to answer all these questions in this passage for you. You see the thing is no matter what task we take in hand we are always going to be slapped in the face with the fear of failing. And as a consequence, our mind makes up excuses for being busy. Stop reading this article for a moment and think the amount of time you spend doing absolutely nothing each day. That's a decent amount of time, isn't it? I'm not saying to give up taking rest after all taking rest powers up our body, but rather I'm talking about the time you spend doing lazily. It doesn't matter if you're a stay at home mom or someone who spends half of his day at the office. If you can take out at least half an hour every day from your daily routine each day you can become a successful Python and Django full stack web developer!
The Basics of Python and Django
This course is for both beginners and veterans. As the beginners are going to learn everything they need to know and the veterans might be able to bridge the gaps that they might have in Python and Django. In this part, we are going to talk about what Python and Django are in detail. If you already know what they are you can skip onto the next part. And if you don't, I request you to stay as this is equally important as anything else on this page.
Let's start with Python. Python is a high-level programming language with dynamic stature. It's a built-in data structure combined with makes it very attractive for rapid web and application development. It also acts as a gluing component for all the existing available components. Python supports modules and packages, which encourages coders for code reusing and modularity. The extensive standard library and Python interpreter are available in source or binary form for free across all major platforms and can be freely distributed.
Now off to Django. It is a free and open-source web application framework written with Python. A framework is just a collection of modules that make development easier. They are usually grouped and allows you to create applications and websites from an existing source. Instead of just beginning from the ground up. A person that designs websites this way can still which can still include advanced functionality like authentication support, management and admin panels, and more. Alternatively, if you were creating a website from nothing you would have to develop all these components by yourself. Instead, if you use a framework you can find these components already built. All you need to do is configure them properly to match your site.
Advantages of learning Python and Django
Now here comes the fun part where you get to know the reward for learning Python and Django full-stack web development course. Recently Python development has become a lucrative job in the industry. At every level of the Information technology industry, the has been a surge in the demand for python developers in recent times. Companies like Uber, Amazon, Swiggy, and Oyo are always on the lookout for full-stack web developers. Can you guess what might be an average salary of a full-stack web developer? No? Take a guess! I'll right I'm going to tell you. It's a six-figure salary! On average every year a full stack developer earns up to 100,273$ every year! Full-time employees have the highest average salaries, making around $98,949 every year. Freelance contractors make $92,311, while self-employed developers make $82,293 every year. Though experienced developers earn more compared to freshers, the difference isn't that big. According to surveys the difference between a fresher and a seasoned campaigner can be as big as 10,000$. Even still it's a great amount to start with as like everything salaries will scale too at a certain expense of time. And if you're looking towards being a freelancer the whole world is yours as there is no limit to how much you can earn!
The Python and Django web developer Bootcamp
Congratulations upon reaching this part of the article as if you're reading this right now, I'm certain that you have utmost interest in learning Python and Django full-stack web development. Relatively Python programming language could seem very hard to learn especially to those who are new to the world of coding. But as hard as it may seem it's not! Trust me! There are a lot of online learning courses that you can join. Yes, I know you might have the question which one of them is the best for you. Let me explain a few things that you are going to need to join the ranks of Python and Django full stack web developer. I recommend Python and Django full stack web developer Bootcamp as it has all the necessary tools alongside great interactive lectures that allow you to learn as if you're attending the class live!
1. Find out if you have what it takes
Sometimes what a person fails to realize is that it's not high-performance computers of expensive software that makes a person a good web developer rather it's the personal determination and will to thrive for the best that makes a person a good web developer. I know a lot of people who had good starts on the road to become a good developer but after some time they burned out of their will to learn. You may ask the question why? Well, most of the online courses aren't up to the mark as they don't provide either with all the content of their respective courses or can't keep the person interested in the course till the end. Which is why most people don't end up as a web developer. That's why before going on to what you need to learn you need to make up your mind about whether or not you're ready to dedicate yourself towards learning and are you ready to take up a good course for learning.
2. The mandatories
Ok, now with all that serious talk out of the way let's talk about something a bit more interesting, shall we? This is going to be relatively short as you don't need much at all! All you will need is a computer with an internet connection and you should be good to go. This bit is all you thought you'd get from this part, right? Nope! I got a couple of tips and tricks to share with you. Don't hesitate to ask for help online in various coding discussion group if you're stuck. You'll also need the internet for connecting with the community of the online course that you'll subscribe to.
3. Python and Django full stack web developer Bootcamp
So, here's the part that you're looking towards most probably. Now we're going to talk about why you need to join a Bootcamp course to be a Python and Django full stack web developer. You see as I've mentioned in the article previously there are a ridiculous amount of online tutorial to be found on the internet. But most of them can't assure you of the total completion of your respective topic. If we were to take the amount to a definitive amount, it would be about 95% of the courses found online. That's why I recommend taking Python and Django web developer course. If you didn't know already, a Bootcamp course is a course where they teach you all the necessary important bits to get you hired into a well-established company like Google and Amazon. Though this isn't nearly as hard as the real-life Bootcamp that the army goes to, it's used as a metaphorical term to indicate to you that you won't be left out of anything in this Bootcamp course. This course is probably the best course out there to learn python and Django web development. I'm guessing you still have confusion regarding this course. Don't worry! Down below you can find a full-fledged review of the Python and Django full stack web developer Bootcamp course! Check it out!
Why I recommend this course
The Python and Django full stack web developer Bootcamp course by Jose Portilla might just be the best course out there on the internet to learn Python and Django. He provides his Video Lectures in high definition video quality. He also has advanced teaching techniques like Walkthrough Code, Projects, Concept Presentation Slides, Downloadable Code Notes, and Reading Assignments. This course contains a variety of different topics that relate to each other. For example, from simple topics like HTML5 to difficult topics like Cloning projects and debug toolbar, this course has it all. This course serves as your one-stop-shop for everything you need! It also serves as a useful reference for many of your questions as you begin your journey towards becoming a web developer. And like this course promises you, it does act like a Bootcamp and teaches you all that you need to get hired into the best companies around. Although some topics like bootstrap need a bit of fine-tuning it's still one of the best possible courses that can be found on the internet.
- A computer.
- An internet connection.
Topics to learn
This course has a lot to offer but I'll include the highlights.
- Creating functional websites using Django 1.11
- Understanding HTTP.
- Learning python to code out web applications.
- Implementing a template structure for websites.
- Learning Jquery and Dom.
- Learning to use Django as a back end for a website.
Buyers Feedback
- Bestseller.
- Over 92,200 enrollments.
- Rated 4.5 stars of 5 by over 22 thousand+ users.
- Rated 5 stars by 58% of the users.
With the number of websites and tech developments increasing as each moment passes by, we can only assume how much the demand for Python and Django developers will surge in the years to come. One might assume this article to be just a blunder but you're intelligent enough to decide that yourself. We care about your time and money and that's why we don't want to suggest any random courses and rather suggest our handpicked courses that might be your worthwhile. With that being said I'd like to say that Python and Django full stack web developer Bootcamp course is truly the best course around and you won't regret buying this.


text:
Using PXF to Query External System Data
Using PXF to Query External System Data
PXF is an extensible framework that allows HAWQ to query external system data. PXF includes built-in connectors for accessing data that exists inside HDFS files, Hive tables, and HBase tables. Users can also create their own connectors to other parallel data stores or processing engines. To create these connectors using JAVA plugins, see the PXF External Tables and API.
Configuring PXF
Setting up the Java Classpath
The classpath of PXF service is set during the installation process. Administrators should only modify it when adding new PXF connectors. The classpath is defined in two files:
- /etc/gphd/pxf/conf/pxf-private.classpath - contains all the required resources to run the service, including pxf-hdfs, pxf-hbase and pxf-hive plugins.This file must not be edited or removed.
- /etc/gphd/pxf/conf/pxf-public.classpath - user defined resources can be added here, for example for running a user defined plugin.The classpath resources should be defined one per line. Wildcard characters can be used in the name of the resource, but not in the full path.
After changing the classpath files, the PXF service must be restarted. Resources can also be added to the staging /usr/lib/gphd/publicstage directory (see About the Public Directory below).
Setting up the JVM Command Line Options for the PXF Service
The pxf service JVM command line options can be added/modified for each pxf-service instance in the /var/gphd/pxf/pxf-service/bin/setenv.sh file:
JVM_OPTS="-Xmx512M -Xss256K"
After adding/modifying the JVM command line options, the PXF service must be restarted.
Secure PXF
PXF can be used on a secure HDFS cluster. Read, write and analyze operations for PXF tables on HDFS files are enabled. It requires no changes to prexisting PXF tables from a previous version.
- Both HDFS and YARN principals are created and are properly configured.
- HDFS uses port 8020 (see the note below).
- HAWQ is correctly configured to work in secure mode, according to the
instructions in the HAWQ guide. Note:
- The HDFS Namenode port must be 8020. This is a limitation that will be fixed in the next PXF version.
- Please refer to the troubleshooting section for common errors related to PXF security, and their meaning.
Reading and Writing Data with PXF
PXF comes with a number of built-in connectors for reading data that exists inside HDFS files, Hive tables, HBase tables, and for writing data into HDFS files. These built-in connectors use the PXF extensible API. You can also use the extensible API to create your own connectors to any other type of parallel data store or processing engine. See PXF External Tables and API for more information about the API.
This topic contains the following information:
- Accessing HDFS File Data with PXF (Read + Write)
- Accessing HIVE Data with PXF (Read only)
- Accessing HBase Data with PXF (Read only)
Built-in Profiles
A profile is a collection of common metadata attributes. Use the convenient and simplified PXF syntax.
PXF comes with a number of built-in profiles that group together a collection of metadata attributes to achieve a common goal:
|Read or write delimited single line records from or to plain text files on HDFS.
|Read delimited single or multi-line records (with quoted linefeeds) from plain text files on HDFS.This profile is not splittable (non parallel); therefore reading is slower than reading with HdfsTextSimple.
|Use this when connecting to Hive. The Hive table can use any of the available storage formats: text, RC, ORC, Sequence, or Parquet.
|Use this when connecting to a Hive table
where each partition is stored as an RCFile. It is optimized for
Note: The DELIMITER parameter is mandatory.
|Use this when connecting to a Hive table where each partition is
stored as a text file. It is optimized for it.
Note: The DELIMITER parameter is mandatory.
|Use this when connected to an HBase data store engine.
|Reading Avro files (i.e fileName.avro).
Adding and Updating Profiles
Administrators can add new profiles or edit the built-in profiles inside pxf-profiles.xml (and apply them with the Pivotal Hadoop (HD) Enterprise Command Line Interface). You can use the all the profiles in pxf-profiles.xml.
Each profile has a mandatory unique name and an optional description.
In addition, each profile contains a set of plugins that are an extensible set of metadata attributes.
Custom Profile Example
<profile> <name>MyCustomProfile</name> <description>A Custom Profile Example</description> <plugins> <fragmenter>package.name.CustomProfileFragmenter</fragmenter> <accessor>package.name.CustomProfileAccessor</accessor> <customPlugin1>package.name.MyCustomPluginValue1</customPlugin1> <customPlugin2>package.name.MyCustomPluginValue2</customPlugin2> </plugins> </profile>
Deprecated Classnames
In past versions of PXF, connector class names could be used without their package names:e.g. HdfsDataFragmenter instead of com.pivotal.pxf.plugins.hdfs.HdfsDataFragmenter.
This has changed in the last version. While package-less classes can still be used, a warning will be issued upon creation and use of any table.
WARNING: Use of HdfsDataFragmenter is deprecated and it will be removed on the next major version DETAIL: Please use the appropriate PXF profile for forward compatibility (e.g. profile=HdfsTextSimple)
Please note that the next major release will not support the old names.That means a "class not found" error message will be issued.
To avoid future deprecation issues, PXF Profiles should be used. Recommended built-in PXF profiles:
|Old name
|HdfsDataFragmenter, TextFileAccessor, TextResolver
|HdfsDataFragmenter, QuotedLineBreakAccessor, TextResolver
|HdfsDataFragmenter, AvroFileAccessor, AvroResolver
|HdfsDataFragmenter, SequenceFileAccessor, CustomWritable
|HBaseDataFragmenter, HBaseAccessor, HBaseResolver
|HiveDataFragmenter, HiveAccessor, HiveResolver
The following table shows old versus new class names:
|Old Name
|New Name
|TextFileAccessor, LineBreakAccessor, LineReaderAccessor
|TextResolver, StringPassResolver
Accessing HDFS File Data with PXF
Installing the PXF HDFS plugin
Install the PXF HDFS plugin jar file on all nodes in the cluster:
sudo rpm -i pxf-hdfs-220.127.116.11-x.rpm
- PXF RPMs reside in the Pivotal ADS/HAWQ stack file.
- The script installs the JAR file at the default location at /usr/lib/gphd/pxf-18.104.22.168. The Softlink pxf-hdfs.jar will be created in /usr/lib/gphd/pxf
- Pivotal recommends that you test PXF on HDFS before connecting to Hive or HBase.
- PXF on secure HDFS clusters requires NameNode to be configured on port 8020.
- HBase/Hive configurations requiring user authentication are not supported.
About the Public Directory
PXF provides a space to store your customized serializers and schema files on the filesystem. You must add schema files on all the datanodes and restart the cluster. The RPM creates the directory at the default location: /usr/lib/gphd/publicstage.
Ensure that all HDFS users have read permissions to HDFS services and limit write permissions to specific users.
The syntax for accessing an HDFS file is as follows:
CREATE [READABLE|WRITABLE] EXTERNAL TABLE <tbl_name> (<attr list>) LOCATION ('pxf://<name_node_hostname:51200>/<path_to_file_or_directory>?Profile=<chosen_profile>[&<additional_options>=<value>]') FORMAT '[TEXT | CSV | CUSTOM]' (<formatting_properties>) [ [LOG ERRORS INTO <error_table>] SEGMENT REJECT LIMIT <count> [ROWS | PERCENT] ]; SELECT ... FROM <tbl_name>; --to read from hdfs with READABLE table. INSERT INTO <tbl_name> ...; --to write to hdfs with WRITABLE table.
To read the data in the files or to write based on the existing format, you need to select the FORMAT, Profile, or one of the classes.
This topic describes the following:
- FORMAT clause
- Profile
- Accessor
- Resolver
- Avro
FORMAT clause
To read data, use the following formats with any PXF connector:
- FORMAT 'TEXT': Use with plain delimited text files on HDFS.
- FORMAT 'CSV': Use with comma-separated value files on HDFS.
- FORMAT 'CUSTOM': Use with all other files, including Avro format and binary formats. Must always be used with the built-in formatter 'pxfwritable_import' (for read) or 'pxfwritable_export' (for write).
For plain or comma-separated text files use either the [HdfsTextSimple | HdfsTextMulti] Profile or a com.pivotal.pxf.plugins.hdfs.HdfsDataFragmenter for the HDFS file data. Use the Avro profile for Avro files.
The choice of an Accessor depends on the HDFS data file type.
|File Type
|FORMAT clause
|Plain Text delimited
|FORMAT 'TEXT' (<format param list>)
|Read + Write
|Plain Text CSV
|FORMAT 'CSV' (<format param list>)
LineBreakAccessor is parallel and faster.
Use if each logical data row is a physical data line.
Read + Write
QuotedLineBreakAccessor is slower and non parallel.
Use if the data includes embedded (quoted) linefeed characters.
Read Only
|FORMAT 'CUSTOM' (formatter='pxfwritable_import')
|Read + Write (use formatter='pxfwritable_export' for write)
|FORMAT 'CUSTOM' (formatter='pxfwritable_import')
|Read Only
Choose the Resolver format if data records are serialized in the HDFS file.
|Record Serialization
|Java Writable
|None (plain text)
Schema File Guidelines for WritableResolver
When using a WritableResolver, a schema file needs to be defined. The file needs to be a Java class file and must be on the class path of PXF.
The class file must follow the following requirements:
- Must implement org.apache.hadoop.io.Writable interface.
- WritableResolver uses reflection to recreate the schema and populate its fields (for both read and write). Then it uses the Writable interface functions to read/write.Therefore, fields must be public, to enable access to them. Private fields will be ignored.
- Fields are accessed and populated by the order in which they are declared in the class file.
- Supported field types:
- boolean
- byte array
- double
- float
- int
- long
- short
- string
Arrays of any of the above types is supported, but the constructor must define the array size, so the reflection will work.
Additional Options
|Option Name
|(Avro or Hive profiles only.) The delimiter character(s) to place between entries in a top-level array, map, or record field when PXF maps a Hive or Avro complex data type to a text column. The default is a "," character.
|(Avro or Hive profiles only.) The delimiter character(s) to place between the key and value of a map entry when PXF maps a Hive or Avro complex data type to a text colum. The default is a ":" character.
|(Avro profile only.) The delimiter character(s) to place between the field name and value of a record entry when PXF maps an Avro complex data type to a text colum. The default is a ":" character.
|The data schema file used to create and
read the HDFS file. For example, you could create an avsc (for Avro),
or a Java class (for Writable Serialization) file. Check that the file
exists on the public directory (see About the Public
This option has no default value.
|Determines if the table query can run
in multithread mode or not. When set to FALSE, requests will be
handled in a single thread.
Should be set when a plugin or other elements that are not thread safe are used (e.g. compression codec).
Allowed values: TRUE, FALSE. Default value is TRUE - requests can run in multithread mode.
|Any option added to the pxf URI string will be accepted and passed, along with its value, to the Fragmenter, Accessor, Analyzer and Resolver implementations.
Accessing Data on a High Availability HDFS Cluster
To access data on a High Availability HDFS cluster, you need to change the authority in the URI in the LOCATION. Use <HA nameservice> instead of <name node host:51200>.
CREATE [READABLE|WRITABLE] EXTERNAL TABLE <tbl name> (<attr list>) LOCATION ('pxf://<HA nameservice>/<path to file or directory>?Profile=<chosen profile>[&<additional options>=<value>]') FORMAT '[TEXT | CSV | CUSTOM]' (<formatting properties>);
The opposite is true when a highly available HDFS cluster is reverted to a single namenode configuration. In that case, any table definition that has the nameservice specified should use the <NN host>:<NN rest port> syntax.
Using a Record Key with Key-Value File Formats
For sequence file and other file formats that store rows in a key-value format, the key value can be accessed through HAWQ by using the saved keyword 'recordkey' as a field name.
The field type must correspond to the key type, much as the other fields must match the HDFS data.
WritableResolver supports read and write of recordkey, which can be of the following Writable Hadoop types:
- BooleanWritable
- ByteWritable
- DoubleWritable
- FloatWritable
- IntWritable
- LongWritable
- Text
If the recordkey field is not defined, the key is ignored in read, and a default value (segment id as LongWritable) is written in write.
Let's say we have a data schema Babies.class containing 3 fields: (name text, birthday text, weight float).
An external table must include these three fields, and can either include or ignore the recordkey.
-- writable table with recordkey CREATE WRITABLE EXTERNAL TABLE babies_registry (recordkey int, name text, birthday text, weight float) LOCATION ('pxf://namenode_host:51200/babies_1940s? ACCESSOR=com.pivotal.pxf.plugins.hdfs.SequenceFileAccessor&RESOLVER=com.pivotal.pxf.plugins.hdfs.WritableResolver&DATA-SCHEMA=Babies') FORMAT 'CUSTOM' (formatter='pxfwritable_export'); INSERT INTO babies_registry VALUES (123456, "James Paul McCartney", "June 18, 1942", 3.800); -- writable table without recordkey CREATE WRITABLE EXTERNAL TABLE babies_registry2 (name text, birthday text, weight float) LOCATION ('pxf://namenode_host:51200/babies_1940s?ACCESSOR=com.pivotal.pxf.plugins.SequenceFileAccessor&RESOLVER=com.pivotal.pxf.plugins.WritableResolver&DATA-SCHEMA=Babies') FORMAT 'CUSTOM' (formatter='pxfwritable_export'); INSERT INTO babies_registry VALUES ("Richard Starkey", "July 7, 1940", 4.0); -- this record's key will have some default value
The same goes for reading data from an existing file with a key-value format, e.g. a Sequence file.
-- readable table with recordkey CREATE EXTERNAL TABLE babies_1940 (recordkey int, name text, birthday text, weight float) LOCATION ('pxf://namenode_host:51200/babies_1940s?ACCESSOR=com.pivotal.pxf.plugins.hdfs.SequenceFileAccessor&RESOLVER=com.pivotal.pxf.plugins.hdfs.WritableResolver&DATA-SCHEMA=Babies') FORMAT 'CUSTOM' (formatter='pxfwritable_import'); SELECT * FROM babies_1940; -- retrieves each record's key -- readable table without recordkey CREATE EXTERNAL TABLE babies_1940_2 (name text, birthday text, weight float) LOCATION ('pxf://namenode_host:51200/babies_1940s?ACCESSOR=com.pivotal.pxf.plugins.hdfs.SequenceFileAccessor&RESOLVER=com.pivotal.pxf.plugins.hdfs.WritableResolver&DATA-SCHEMA=Babies') FORMAT 'CUSTOM' (formatter='pxfwritable_import'); SELECT * FROM babies_1940_2; -- ignores the records' key
Working with Avro Files
Avro files combine their data with a schema, and can support complex data types such as arrays, maps, records, enumerations, and fixed types. When you create a PXF external table to represent Avro data, map top-level fields in the schema that use a primitive data type to HAWQ columns of the same type. Map top-level fields that use a complex data type to a TEXT column in the external table. The PXF Avro profile automatically separates components of a complex type by inserting delimiters in the text column. You can then use functions or application code to further process components of the complex data.
The following table summarizes external table mapping rules for Avro data.
|Avro Data Type
|PXF Type
|Primitive type (int, double, float, long, string, bytes, boolean)
|Corresponding HAWQ data type. See Data Types.
|Complex type: Array, Map, Record, or Enum
|TEXT, with default delimiters inserted between collection items, mapped key-value pairs, and record data.
|Complex type: Fixed
|Follows the above conventions for primitive or complex data types, depending on the union. Null values are supported in Unions.
For complex types, the PXF Avro profile inserts default delimiters between collection items and values. You can use non-default delimiter characters by including the COLLECTION_DELIM, MAPKEY_DELIM, and/or RECORDKEY_DELIM optional parameters to the Avro profile. See Table 1 for a description of the parameters.
The following example uses the Avro schema shown in Sample Avro Schema and the associated data file shown in Sample Avro Data (JSON).
Sample Avro Schema
{ "type" : "record", "name" : "example_schema", "namespace" : "com.example", "fields" : [ { "name" : "id", "type" : "long", "doc" : "Id of the user account" }, { "name" : "username", "type" : "string", "doc" : "Name of the user account" }, { "name" : "followers", "type" : {"type": "array", "items": "string"}, "doc" : "Users followers" }, { "name": "rank", "type": ["null", "int"], "default": null }, { "name": "fmap", "type": {"type": "map", "values": "long"} }, { "name": "address", "type": { "type": "record", "name": "addressRecord", "fields": [ {"name":"number", "type":"int"}, {"name":"street", "type":"string"}, {"name":"city", "type":"string"}] } }, { "name": "relationship", "type": { "type": "enum", "name": "relationshipEnum", "symbols": ["MARRIED","LOVE","FRIEND","COLLEAGUE","STRANGER","ENEMY"] } }, { "name" : "md5", "type": { "type" : "fixed", "name" : "md5Fixed", "size" : 4 } ], "doc:" : "A basic schema for storing messages" }
Sample Avro Data (JSON)
{"id":1, "username":"john","followers":["kate", "santosh"], "rank":null, "relationship": "FRIEND", "fmap": {"kate":10,"santosh":4}, "address":{"street":"renaissance drive", "number":1,"city":"san jose"}, "md5":\u3F00\u007A\u0073\u0074} {"id":2, "username":"jim","followers":["john", "pam"], "rank":3, "relationship": "COLLEAGUE", "fmap": {"john":3,"pam":3}, "address":{"street":"deer creek", "number":9,"city":"palo alto"}, "md5":\u0010\u0021\u0003\u0004}
gpadmin=# CREATE EXTERNAL TABLE avro_complex (id bigint, username text, followers text, rank int, fmap text, address text, relationship text, md5 bytea) LOCATION ('pxf://localhost:51200/tmp/avro_complex?PROFILE=Avro') FORMAT 'CUSTOM' (FORMATTER='pxfwritable_import');
gpadmin=# CREATE EXTERNAL TABLE avro_complex (id bigint, username text, followers text, rank int, fmap text, address text, relationship text, md5 bytea) LOCATION ('pxf://localhost:51200/tmp/avro_complex?PROFILE=Avro&COLLECTION_DELIM=,&MAPKEY_DELIM=:&RECORDKEY_DELIM=:') FORMAT 'CUSTOM' (FORMATTER='pxfwritable_import');
gpadmin=# select * from avro_complex; id | username | followers | rank | fmap | address | relationship | md5 1| john | [kate,santosh] | | {kate:10,santosh:4} | {number:1,street:renaissance drive,city:san jose} | FRIEND | ?zst 2| jim | [john,pam] | 3 | {john:3,pam:3} | {number:9,street:deer creek,city:palo alto} | COLLEAGUE | \020!\003\004
gpadmin=# create view followers_view as select username, address, string_to_array(substring(followers from 2 for (char_length(followers) - 2)), ',')::text[] as followers from avro_complex; gpadmin=# select username, address from followers_view where john = ANY(followers); username | address jim | {number:9,street:deer creek,city:palo alto}
Accessing Hive Data with PXF
Installing the PXF HIVE Plugin
Install the PXF HIVE plugin on all nodes in the cluster:
sudo rpm -i pxf-hive-220.127.116.11-x.rpm
- PXF RPMs reside in the Pivotal ADS/HAWQ stack file.
- The script installs the JAR file at the default location at /usr/lib/gphd/pxf-188.8.131.52. The Softlink pxf-hive.jar will be created in /usr/lib/gphd/pxf.
Check the following before adding PXF support on Hive:
- PXF HDFS plugin is installed on the cluster nodes.
- You are running the Hive Metastore service on a machine in your cluster.
- Check that you have set the hive.metastore.uris property in the hive-site.xml on the Namenode.
- The Hive JAR files and conf directory are installed on the cluster nodes.
Hive tables are always defined in a specific way in PXF, regardless of the underlying file storage format. The PXF Hive plugins automatically detect source tables:
- Text based
- SequenceFile
- RCFile
- ORCFile
- Parquet
- Avro
The source table can also be a combination of these types. The PXF Hive plugin uses this information to query the data in runtime. The following PXF table definition is valid for any file storage type.
CREATE EXTERNAL TABLE hivetest(id int, newid int) LOCATION ('pxf://<NN host>:51200/<hive table name>?PROFILE=Hive') FORMAT 'custom' (formatter='pxfwritable_import'); SELECT * FROM hivetest;
Hive Command Line
To start the Hive command line and work directly on a Hive table:
Here's an example of how to create and load data into a sample Hive table from an existing file.
Hive> CREATE TABLE test (name string, type string, supplier_key int, full_price double) row format delimited fields terminated by ','; Hive> LOAD DATA local inpath '/local/path/data.txt' into table test;
Mapping Hive Complex Types
PXF supports Hive data types that are not primitive types. The supported Hive complex data types are: array, struct, map, and union. For example :
CREATE TABLE sales_collections ( item STRING, price FLOAT, properties ARRAY<STRING>, hash MAP<STRING,FLOAT>, delivery_address STRUCT<street:STRING, city:STRING, state:STRING, zip:INT>, others UNIONTYPE<FLOAT, BOOLEAN, STRING> ) ROW FORMAT DELIMITED FIELDS TERMINATED BY '\001' COLLECTION ITEMS TERMINATED BY '\002' MAP KEYS TERMINATED BY '\003' LINES TERMINATED BY '\n' STORED AS TEXTFILE; LOAD DATA LOCAL INPATH '/local/path/<some data file>' INTO TABLE sales_collection;
To query a Hive table schema similar to the one in the example, you define the PXF external table with a text column for each corresponding complex type. PXF automatically inserts default delimiter characters between components of the complext type, or you can specify the delimiters to use with paramters to the Hive profile (see Table 1). For example:
CREATE EXTERNAL TABLE gp_sales_collections( item_name TEXT, item_price REAL, properties TEXT, hash TEXT, delivery_addresses TEXT, others TEXT ) LOCATION ('pxf://<namenode_host>:51200/sales_collections?PROFILE=Hive&COLLECTION_DELIM=,&MAPKEY_DELIM=:') FORMAT 'custom' (FORMATTER='pxfwritable_import');
You can use functions or application code to extract the components of the complex data columns as necessary.
Partition Filtering
The PXF Hive plugin uses the Hive partitioning feature and directory structure. This enables partition exclusion on HDFS files that contain the Hive table. To use the Partition Filtering feature to reduce network traffic and I/O, run a PXF query using a WHERE clause that refers to a specific partition in the partitioned Hive table.
To take advantage of PXF Partition filtering push-down, name the partition fields in the external table. These names must be the same as those stored in the Hive table. Otherwise, PXF ignores Partition filtering and the filtering is performed on the HAWQ side, impacting performance.
Create a Hive table sales_part with 2 partition columns - delivery_state and delivery_city:
CREATE TABLE sales_part (name STRING, type STRING, supplier_key INT, price DOUBLE) PARTITIONED BY (delivery_state STRING, delivery_city STRING) ROW FORMAT DELIMITED FIELDS TERMINATED BY ',';
Load data into this Hive table and add some partitions:
LOAD DATA LOCAL INPATH '/local/path/data1.txt' INTO TABLE sales_part PARTITION(delivery_state = 'CALIFORNIA', delivery_city = 'San Francisco'); LOAD DATA LOCAL INPATH '/local/path/data2.txt' INTO TABLE sales_part PARTITION(delivery_state = 'CALIFORNIA', delivery_city = 'Sacramento'); LOAD DATA LOCAL INPATH '/local/path/data3.txt' INTO TABLE sales_part PARTITION(delivery_state = 'NEVADA' , delivery_city = 'Reno'); LOAD DATA LOCAL INPATH '/local/path/data4.txt' INTO TABLE sales_part PARTITION(delivery_state = 'NEVADA' , delivery_city = 'Las Vegas');
The Hive storage directory should appears as follows:
/hive/warehouse/sales_part/delivery_state=CALIFORNIA/delivery_city='San Francisco'/data1.txt /hive/warehouse/sales_part/delivery_state=CALIFORNIA/delivery_city=Sacramento/data2.txt /hive/warehouse/sales_part/delivery_state=NEVADA/delivery_city=Reno/data3.txt /hive/warehouse/sales_part/delivery_state=NEVADA/delivery_city='Las Vegas'/data4.txt
To define a PXF table to read this Hive table and take advantage of partition filter push-down, define the fields corresponding to the Hive partition fields at the end of the attribute list.
When defining an external table, check that the fields corresponding to the Hive partition fields are at the end of the column list. In HiveQL, issuing a select* statement on a partitioned table shows the partition fields at the end of the record.
CREATE EXTERNAL TABLE pxf_sales_part( item_name TEXT, item_type TEXT, supplier_key INTEGER, item_price DOUBLE PRECISION, delivery_state TEXT, delivery_city TEXT ) LOCATION ('pxf://namenode_host:51200/sales_part?Profile=Hive') FORMAT 'custom' (FORMATTER='pxfwritable_import'); SELECT * FROM pxf_sales_part;
In the following example, the HAWQ query filters the delivery_city partition Sacramento. The filter on item_name is not pushed down, since it is not a partition column. It is performed on the HAWQ side after all the data on Sacramento is transferred for processing.
SELECT * FROM pxf_sales_part WHERE delivery_city = 'Sacramento' AND item_name = 'shirt';
The following HAWQ query reads all the data under delivery_city partition CALIFORNIA, regardless of the city partition.
SELECT * FROM pxf_sales_part WHERE delivery_state = 'CALIFORNIA'
Using PXF with Hive Default Partitions
This topic describes a difference in query results between Hive and PXF queries when Hive tables use a default partition.
When dynamic partitioning is enabled in Hive, a partitioned table may store data in a default partition. Hive creates a default partition when the value of a partitioning column does not match the defined type of the column (for example, when a NULL value is used for any partitioning column). In Hive, any query that includes a filter on a partition column excludes any data that is stored in the table's default partition.
Similar to Hive, PXF represents a table's partitioning columns as columns that are appended to the end of the table. However, PXF translates any column value in a default partition to a NULL value. This means that a HAWQ query that includes an IS NULL filter on a partitioning column can return different results as compared to the same Hive query.
CREATE TABLE sales (order_id bigint, order_amount float) PARTITIONED BY (date date);The table is loaded with five rows that contain the following data:
1 1.0 1900-01-01 2 2.2 1994-04-14 3 3.3 2011-03-31 4 4.5 NULL 5 5.0 2013-12-06In this case, the insertion of row 4 creates a Hive default partition, because the partition column "date" contains a null value.
hive> select * from sales where date is null;
However, if you map this table as a PXF external table in HAWQ, all default partition values are translated into actual NULL values. In HAWQ, executing the same query against the PXF table returns row 4 as the result, because the filter matches the NULL value.
Keep this behavior in mind when executing IS NULL queries on Hive partitioned tables.
Accessing Hive Tables in Parquet Format
create table hive_parquet_table (fname string, lname string, custid int, acctbalance double) stored as parquet;
create external table pxf_parquet_table (fname text, lname text, custid int, acctbalance double precision) location ('pxf://localhost:51200/hive_parquet_table?profile=Hive') format 'custom' (formatter='pxfwritable_import');
Accessing HBase Data with PXF
Installing the PXF HBase Plugin
Install the PXF HBase plugin on all nodes in the cluster:
sudo rpm -i pxf-hbase-188.8.131.52-x.rpm
- PXF RPMs reside in the Pivotal ADS/HAWQ stack file.
- The script installs the JAR file at the default location at /usr/lib/gphd/pxf-184.108.40.206. The Softlink pxf-hbase.jar will be created in /usr/lib/gphd/pxf.
Before using the PXF HBase plugin, verify the following:
- PXF HDFS plugin is installed on the cluster nodes.
- HBase and zookeeper jars are installed on the cluster nodes.
- The /etc/hbase/hbase-env.sh configuration file must
reference the pxf-hbase.jar. For example,
/etc/hbase/hbase-env.sh should include the
export HBASE_CLASSPATH=\ `echo /usr/lib/gphd/pxf/pxf-hbase.jar`:\Note: You must restart HBase after making any changes to the HBase configuration.
To query an HBase table, use the following syntax:
CREATE EXTERNAL TABLE <pxf tblname> (<col list - see details below>) LOCATION ('pxf://<NN REST host>:<NN REST port>/<HBase table name>?PROFILE=HBase') FORMAT 'CUSTOM' (FORMATTER='pxfwritable_import'); SELECT * FROM <pxf tblname>;
Column Mapping
Most HAWQ external tables (PXF or others) require that the HAWQ table attributes match the source data record layout, and include all the available attributes. However, use the PXF HBase plugin to specify the subset of HBase qualifiers that define the HAWQ PXF table. To set up a clear mapping between each attribute in the PXF table and a specific qualifier in the HBase table, you can use either:
- Direct mapping
- Indirect mapping
In addition, the HBase row key is handled in a special way.
Row Key
You can use the HBase table row key in several ways. For example, you can see them using query results, or you can run a WHERE clause filter on a range of row key values. To use the row key in the HAWQ query, define the HAWQ table with the reserved PXF attribute recordkey. This attribute name tells PXF to return the record key in any key-value based system and in HBase.
CREATE EXTERNAL TABLE <tname> (recordkey bytea, ... ) LOCATION ('pxf:// ...')
Direct Mapping
Use Direct Mapping to map HAWQ table attributes to HBase qualifiers. You can specify the HBase qualifier names of interest, with column family names included, as quoted values.
For example, you have defined an HBase table called hbase_sales with multiple column families and many qualifiers. To see the following in the resulting attribute section of the CREATE EXTERNAL TABLE:
- rowkey
- qualifier saleid in the column family cf1
- qualifier comments in the column family cf8
CREATE EXTERNAL TABLE hbase_sales ( recordkey bytea, "cf1:saleid" int, "cf8:comments" varchar ) ...
The PXF HBase plugin uses these attribute names as-is and returns the values of these HBase qualifiers.
Indirect Mapping (via Lookup Table)
Direct mapping method is fast and intuitive, but using indirect mapping helps to reconcile HBase qualifier names with HAWQ behavior:
- HBase qualifier names that are longer than 32 characters. HAWQ has a 32 character limit on attribute name size.
- HBase qualifier names can be binary or non-printable. HAWQ attribute names are character based.
In either case, Indirect Mapping uses a lookup table on HBase. You can create the lookup table to store all necessary lookup information. This works as a template for any future queries. The name of the lookup table must be pxflookup and must include the column family named mapping.
<hawq attr name>=<hbase cf:qualifier>.
|(row key)
CREATE EXTERNAL TABLE hbase_sales ( recordkey bytea id int, cmts varchar ) ...
PXF automatically matches HAWQ to HBase column names when a pxflookup table exists in HBase.
The following table describes some common errors while using PXF:
|Common Explanation
|ERROR: invalid URI pxf://localhost:51200/demo/file1: missing options section
|LOCATION does not include options after the file name: <path>?<key>=<value>&<key>=<value>...
|ERROR: protocol "pxf" does not exist
|HAWQ is not compiled with PXF protocol. It requires the GPSQL version of HAWQ version.
|ERROR: remote component error (0) from '<x>': There is no pxf servlet listening on the host and port specified in the external table url.
|Wrong server or port or the service is not started.
|ERROR: Missing FRAGMENTER option in the pxf uri: pxf://localhost:51200/demo/file1?a=a
No FRAGMENTER option was specified in LOCATION.
| ERROR: remote component error (500) from
'<x>': type Exception report message
Input path does not exist: hdfs://0.0.0.0:8020/demo/file1
|File or pattern given in LOCATION doesn't exist on specified path.
|ERROR: remote component error (500) from '<x>': type Exception report message org.apache.hadoop.mapred.InvalidInputException : Input Pattern hdfs://0.0.0.0:8020/demo/file* matches 0 files
|File or pattern given in LOCATION doesn't exist on specified path.
|ERROR: remote component error (500) from '<x>': PXF not correctly installed in CLASSPATH
|Cannot find PXF Jar
|ERROR: GPHD component not found
|Either the required data node does not exist or PXF service (tcServer) on data node is not started or PXF webapp was not started.
|ERROR: remote component error (500) from '<x>': type Exception report message java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface
|One of the classes required for running PXF or one of its plugins is missing. Check that all resources in the PXF classpath files exist on the cluster nodes.
|ERROR: remote component error (500) from '<x>': type Exception report message java.io.IOException: Can't get Master Kerberos principal for use as renewer
|Secure PXF: YARN isn't properly configured for secure (Kerberized) HDFS installs
|ERROR: fail to get filesystem credential for uri hdfs://<namenode>:8020/
|Secure PXF: Wrong HDFS host or port is not 8020 (this is a limitation that will be removed in the next release)
|ERROR: remote component error (413) from '<x>': HTTP status code is 413 but HTTP response string is empty
|The PXF table number of attributes and their
name sizes are too large for tcServer to accommodate in its request buffer.
The solution is to increase the value of the maxHeaderCount and
maxHttpHeaderSize parameters on server.xml on tcServer instance on all nodes
and then restart PXF:
<Connector acceptCount="100" connectionTimeout="20000" executor="tomcatThreadPool" maxKeepAliveRequests="15"maxHeaderCount="<some larger value>"maxHttpHeaderSize="<some larger value in bytes>" port="${bio.http.port}" protocol="org.apache.coyote.http11.Http11Protocol" redirectPort="${bio.https.port}"/>
|HBase Specific Errors
|ERROR: remote component error (500) from '<x>': type Exception report message org.apache.hadoop.hbase.client.NoServerForRegionException: Unable to find region for t1,,99999999999999 after 10 tries.
|HBase service is down, probably HRegionServer.
|ERROR: remote component error (500) from '<x>': type Exception report message org.apache.hadoop.hbase.TableNotFoundException: nosuch
|HBase cannot find the requested table
|ERROR: remote component error (500) from '<x>': type Exception report message java.lang.NoClassDefFoundError: org/apache/hadoop/hbase/client/HTableInterface
|PXF cannot find a required JAR file, probably HBase's
|ERROR: remote component error (500) from '<x>': type Exception report message java.lang.NoClassDefFoundError: org/apache/zookeeper/KeeperException
|PXF cannot find Zookeeper's JAR
|ERROR: remote component error (500) from '<x>': type Exception report message java.lang.Exception: java.lang.IllegalArgumentException: Illegal HBase column name a, missing :
|PXF table has an illegal field name. Each field name must correspond to an HBase column in the syntax <column family>:<field name>
|ERROR: remote component error (500) from '<x>': type Exception report message org.apache.hadoop.hbase.regionserver.NoSuchColumnFamilyException: Column family a does not exist in region t1,,1405517248353.85f4977bfa88f4d54211cb8ac0f4e644. in table 't1', {NAME => 'cf', DATA_BLOCK_ENCODING => 'NONE', BLOOMFILTER => 'ROW', REPLICATION_SCOPE => '0', COMPRESSION => 'NONE', VERSIONS => '1', TTL => '2147483647', MIN_VERSIONS => '0', KEEP_DELETED_CELLS => 'false', BLOCKSIZE => '65536', ENCODE_ON_DISK => 'true', IN_MEMORY => 'false', BLOCKCACHE => 'true'}
|Required HBase table does not contain the requested column.
|Hive Specific Errors
|ERROR: remote component error (500) from '<x>': type Exception report message java.lang.RuntimeException: Failed to connect to Hive metastore: java.net.ConnectException: Connection refused
|Hive Metastore service is down.
| ERROR: remote component error (500) from
'<x>': type Exception report message
NoSuchObjectException(message:default.players table not found)
|Table doesn't exist in Hive.


text:
Growth Trends for Related Jobs
There are a number of qualifications and attributes that one should possess to be a bank teller. Specific qualifications can vary from bank to bank, but interpersonal skills are very important. Tellers should have basic computer skills.
Communication Skills
A bank teller should have the ability to communicate effectively and efficiently with the public. These are qualities that make customers more likely to return.
Bank tellers must have the ability to pay attention to detail. An inattentive teller could cost the bank money in terms of mistakes made in transactions. Tellers should have an understanding of security measures and remember details of how to respond during a robbery.
Most banks require that a teller have at least a high school education. If a teller has gone to college, this works in her favor.
Customer Needs
Banks stress the importance of sales skills. Tellers should have the ability to recognize needs of customers through casual conversation, and then refer them to management for further sales activities.
Math Aptitude
Tellers should be very comfortable performing math problems.
Bank tellers should have good personalities and attitudes. Tellers are the first line of defense when it comes to customers. Customers view the tellers as though they are the bank. The first impression they receive is that presented by tellers.
Photo Credits
- Comstock Images/Comstock/Getty Images


text:
Today was a small token of great beauty as we broken ground at the new location of The Farm in Fayetteville (if you hadn't heard we moved to Fayetteville, take a minute to read our Jan 2011 Update).
Gary spent the day on the tractor turning the earth to reveal some very fertile land. We added a little bit (okay, really 12.5 tons) of lime to raise the pH level.
In the coming week or so, we'll be planting our first crops (potatoes) and anxiously awaiting the last frost. Spring is on the way!
Huge thanks to the group of volunteers last Saturday who helped clear some of the land to prepare for today. We are so excited by all of the opportunities that are presenting themselves through The Farm and we should have the seasons Volunteer opportunities posted on the website early next week. So, check back if you would like to spend a little time at The Farm this year.
If you would like to keep current with news and events, you can also follow the Cobblestone Project Farm Twitter Account (http://www.twitter.com/csprojectfarm).


text:
Off the Shoulder Metallic Scuba Evening Dress
Colors: Turquoise, Fuchsia, Emerald
- Fit & Flare
- Metallic Scuba
- Wrap Back Detail
- Off the Shoulder
- Sweetheart Neckline
ASHLEYlauren uses cookies to give you personalized shopping and marketing experiences. By continuing to use our site, you agree to our use of cookies. Learn more here.


text:
Quitting smoking benefits health despite weight gain
The benefits to cardiovascular health that are associated with quitting smoking aren't blunted by the modest weight gain, according to a new study. The findings underscore the benefits of putting a stop to smoking.
Cigarette smoking causes about one in every five deaths in the United States each year. Smoking harms nearly every organ in the body, including the heart, lungs, blood vessels, eyes, reproductive organs, bones, bladder and digestive organs. Smoking cessation greatly lowers the risk of many diseases and conditions, including cardiovascular disease.
About 80 percent of smokers who quit gain weight. Obesity is a risk factor for cardiovascular disease, so health professionals have wondered whether this weight gain might counter the health benefits of quitting. A team of researchers that included Dr. James B. Meigs of Harvard Medical School, Dr. Carole Clair-now at the University of Lausanne, Switzerland-and Dr. Caroline S. Fox of NIH's National Heart, Lung and Blood Institute (NHLBI) set out to investigate.
The researchers analyzed data collected between 1984 and 2011 from over 3,000 adults in the community-based Framingham Heart Study. The participants underwent physical examinations every four years, including measures of weight, blood pressure and diabetes status.
Participants were categorized as smoker, recent quitter (four years or less), long-term quitter (more than four years) or nonsmoker, based on their reported smoking status at each exam. The presence of cardiovascular disease (including heart attack, angina, stroke, peripheral arterial disease and heart failure) was assessed over approximately six years. The study was supported in part by NHLBI and NIH's National Institute of Diabetes and Digestive and Kidney Diseases (NIDDK). Results appeared in the March 13 issue of the Journal of the American Medical Association.
The researchers found that, among participants without diabetes, those who quit smoking had about half the risk of cardiovascular problems as those who smoked. A similar benefit was found among those with diabetes, but the number of participants with diabetes wasn't large enough to ensure this result wasn't due to chance.
Participants without diabetes who were recent quitters gained about six pounds over the four year period since their last exam visit. Long-term quitters gained about two pounds, which was similar to that gained by smokers and nonsmokers. The researchers found that, despite gaining weight, the participants who stopped smoking maintained their lower risk of cardiovascular disease.
"Our findings suggest that a modest weight gain, around 5-10 pounds, has a negligible effect on the net benefit of quitting smoking," Fox says. "Being able to quantify to some degree the relationship between the benefits and side effects of smoking cessation can help in counseling those who have quit or are thinking about quitting."
The researchers plan to conduct follow-up studies to determine whether this finding holds among people with diabetes.
--From the National Institute of Health
For further information on this and other health topics, visit the web site of the National Institute of Health at www.nih.gov.
Health Talk Archives...
Sponsored by:


text:
Job Description
Aerospace Composite Design Engineers and Composite Stress Engineers required for a new project in Filton, Bristol.
Sitec are looking to fill a number of roles on a project for a new client.
The task involves design sizing of composite fuselage structure on a military aircraft. The project team will be based in the Sitec, Church House office in Filton, with an additional integration team being eventually established overseas, local to the client's offices.
Required skills for the Composite Design Engineer and Composite Stress Engineer:
The successful candidate should be able to demonstrate the following characteristics:
* Proven background working as an aircraft design engineer, preferably with Catia V6 experience (Catia V5 experience is essential), working on primary composite structure
* Proven background working as an aircraft stress engineer, using a broad range of standard hand and computational methods on primary composite structure
* A strong team player who shows a high regard for client requirements, whilst maintaining design integrity as the over-riding principle
* Good communication skills and a pro-active approach to problem solving
* Experience of PC and mainframe computer systems
* English, to negotiation level
All candidates must be eligible to work in the UK without restriction and be in a position to obtain UK security clearance to a minimum of BC level.
This vacancy is being advertised by Sitec.


text:
Regular price £336.00 -25% Price £252.00Carron Urban Sit Bath 1250 x 725 x 450mm
- Reduced price
The most popular style of bath would have to be the rectangular shape, used in everyday life. Perfect for family homes these bath come in a variety of different sizes and can be upgraded to Carronite which is twice the strength making the bath even more durable and long-lasting.
There are 3 products.


text:
By buying this product you can collect up to 70 loyalty points. Your cart will total 70 loyalty points that can be converted into a voucher of £ 1.75.
Entirely handmade in solid sterling silver, the detail on this pendant is just amazing and looks just look the real thing, but rather more beautiful cast in silver and teamed with a silver chain. An affirmation of love of all things equine with added style and now with a gorgeous matching bangle to complete this stunning set.
Size: 30mm long including bale for chain x 19 mm wide
Length of chain: 16"
"Thank you a fantastic order delivered very quickly Thank you"


text:
Showing Collections: 1 - 1 of 1
Marshall Mason (1940- ) Papers
Identifier: 31/6/194
Overview Marshall W. Mason (born February 24, 1940; B.A., Northwestern University School of Communication, 1961) is an American theater director, educator, and writer. He founded the Circle Repertory Company in New York City and was artistic director of the company for 18 years (1969-1987). He has received many awards over a long career in the theater, among them an Obie Award for Sustained Achievement in 1983 and, in 2016, the Tony Award for Lifetime Achievement in the Theater. His papers fill 190...
Found in: Northwestern University Archives


text:
What a difference four years makes.
In 2008, during the second presidential debate--a town hall format similar to what we witnessed a few days ago--an audience member asked the two candidates: "I want to know what you would do within the first two years to make sure that Congress moves fast as far as environmental issues, like climate change and green jobs?"
In response, John McCain and Barack Obama both acknowledged the reality of global warming. Obama said it is "one of the biggest challenges of our times" and called for investments in solar, wind and geothermal technologies.
Last Wednesday, both presidential candidates were asked a less direct question. It was an ill-informed one about the Department of Energy's role in lowering gasoline prices, but it opened the door for both candidates to discuss energy issues--and climate change. But instead of reminding Americans about the threat posed by continuing our reliance on fossil fuels, Gov. Romney and President Obama jousted over the price of gasoline--which a president can't control--and bickered over who would do a better job promotingcoal, oil and natural gas.
Yes, Obama did mention "clean" energy technologies as part of his "all of the above" strategy, and Romney said he "believe[s] very much in our renewable capabilities."
And yes, although the first two presidential debates and the vice presidential debate skirted the climate change issue, Romney and Obama did have a brief, heated exchange on it at their respective party conventions and have mentioned it sporadically on the campaign trail.
But given the audience nationally televised debates attract--and the importance of this issue to theeconomy, public health and the future of the planet--scientists, environmentalists and public officials have been urging debate moderators and the two candidates to address it directly.
So far, that hasn't happened.
There is one more debate, however, and appropriately, it will be held in Florida.
Why do I say "appropriately"?
When Romney gave his acceptance speech at the Republican National Convention in Tampa in August, he criticized Obama for promising " to slow the rise of the oceans and to heal the planet."
"My promise," he continued, "is to help you and your family."
The line was a reference to a statement Obama made in 2008 after winning the Democratic presidential nomination. "I am absolutely certain that generations from now," he said, "we will be able to look back and tell our children ... this was the moment when the rise of the oceans began to slow and our planet began to heal."
Read the rest at Huffington Post.


text:
Opera Browser Free Download
Opera Browser Ranking & Summary
OS: Windows 98/XP
License: Freeware
Price: $0
Publisher: Opera Software ASA
Homepage: #
Opera Browser Tags
Opera Browser Description
Opera 10.53 is the fastest Web browser available, and offers many powerful features with a new and beautiful minimalistic design. It is absolutely free and comes in 43 languages. A smart address field makes searching and entering addresses super easy. Private browsing lets you browse without leaving traces of where you've been. Opera Turbo is also included to compress Web pages and boost your browsing speed on croweded Wi-Fi hotspots, tethered mobile phones, or dial-up connections. Download now and get the best Web experience! Or read more at www.opera.com.
Opera Browser Related Software
|Opera 9.5 Desktop Browser Opera 9.5 introduces Opera Link which keeps you synchronized between any Opera 9.5 desktop browser and Opera Mini, Opera?s free browser for your mobile phone. ...
|File size: 4.8 MB
Download now
|opera plugin opera add-on opera opera widget Opera Backup
|Opera Browser for Windows Opera 11 is the fastest browser available and offers more features than any other browser to take advantage of today's Web. This is why more than 50 million people choose Opera for their computers. Do
|File size: 8900K
Download now
|Opera Browser for Mac Opera 11 is the fastest browser available and offers more features than any other browser to take advantage of today's Web. This is why more than 50 million people choose Opera for their computers. Do
|File size: 8900K
Download now
|Opera Web Browser One of the fastest, smallest and smartest full-featured web browser
|File size: 9.8 MB
Download now
|blocker internet download manager Browser Web Browser
|Opera Mini - Mobile browser Opera Mini is a fast and easy alternative to Opera's mobile browser, allowing
|File size: 1 KB
Download now
|opera plugin opera Opera Backup Backup Opera Opera Browser
Opera Browser Company
Opera Software ASA
Company Information:
Opera Browser Reviews
Popular Tags
Top Shareware Download
Top Freeware Download
Recommended Download
- Stellar DBX to PST Converter
- Stellar Phoenix Windows Data Recovery - Home
- Stellar Mailbox Extractor for Exchange Server
- Stellar OLM to PST Converter
- Stellar Phoenix BKF Recovery
- Stellar Phoenix Data Recovery for iOS
- Stellar Phoenix Excel Repair
- Stellar Phoenix JPEG Repair
- Stellar Phoenix Outlook PST Repair
- Stellar Phoenix Photo Recovery - Win