From michael48@example.com Fri Apr 01 00:46:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 1743 invoked from network); 1 Apr 2011 00:46:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 00:46:46 -0000 Received: (qmail 48805 invoked by uid 500); 1 Apr 2011 00:46:46 -0000 Delivered-To: michael48@example.com Received: (qmail 48767 invoked by uid 500); 1 Apr 2011 00:46:46 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 48759 invoked by uid 99); 1 Apr 2011 00:46:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 00:46:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 00:46:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id DDEC68C8B8 for <michael48@example.com>; Fri, 1 Apr 2011 00:46:05 +0000 (UTC) Date: Fri, 1 Apr 2011 00:46:05 +0000 (UTC) From: "Joseph Vychtrle (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Updated] (TIKA-630) Dealing with PDF documents from scanning programs MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joseph Vychtrle updated TIKA-630: --------------------------------- Summary: Dealing with PDF documents from scanning programs (was: Dealing with PDF documents produced from scanning programs) > Dealing with PDF documents from scanning programs > ------------------------------------------------- > > Key: TIKA-630 > URL: https://issues.apache.org/jira/browse/TIKA-630 > Project: Tika > Issue Type: Improvement > Components: general > Affects Versions: 1.0 > Reporter: Joseph Vychtrle > Priority: Minor > Labels: ocr, pdf, > > Hey, > sorry I didn't post this to mailing list, I kinda didn't get the confirmation. > The issue is that often people don't even realize there is a difference in pdf documents (extracted from openoffice/ms office or pdf from a scanner software). And if Tika processes such a document, it detects pdf content type, but there are only images in there. I don't know how to deal with that. There should be a function that decides on the type of PDF document so that I can take it and use some OCR software for the PDF from scanner software. > If there is a way to do that, could please anybody explain how to do that ? -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Fri Apr 01 15:05:53 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 37942 invoked from network); 1 Apr 2011 15:05:51 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 15:05:51 -0000 Received: (qmail 47249 invoked by uid 500); 1 Apr 2011 15:05:48 -0000 Delivered-To: michael48@example.com Received: (qmail 46651 invoked by uid 500); 1 Apr 2011 15:05:47 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 46343 invoked by uid 99); 1 Apr 2011 15:05:47 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 15:05:47 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 15:05:45 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 6EFB58D5B4 for <michael48@example.com>; Fri, 1 Apr 2011 15:05:07 +0000 (UTC) Date: Fri, 1 Apr 2011 15:05:07 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> Subject: [jira] [Created] (TIKA-631) Improve handling of Outlook emails which contain html, and those with non-unicode text bodies MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Improve handling of Outlook emails which contain html, and those with non-unicode text bodies --------------------------------------------------------------------------------------------- Key: TIKA-631 URL: https://issues.apache.org/jira/browse/TIKA-631 Project: Tika Issue Type: Improvement Components: parser Affects Versions: 0.9 Reporter: Nick Burch Assignee: Nick Burch There are two areas in the outlook parsing that could use some enhancement: * If the text content is stored as non unicode strings, we should try to have the right encoding used for this * If the email contains a html or rtf version of the message body, we should prefer this over the plain text one Note - some of these enhancements may need to wait for POI 3.8 beta 3 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Fri Apr 01 16:01:32 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 3413 invoked from network); 1 Apr 2011 16:01:32 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 16:01:32 -0000 Received: (qmail 89703 invoked by uid 500); 1 Apr 2011 16:01:32 -0000 Delivered-To: michael48@example.com Received: (qmail 89678 invoked by uid 500); 1 Apr 2011 16:01:31 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 89670 invoked by uid 99); 1 Apr 2011 16:01:31 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:01:31 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO aegis.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:01:29 +0000 Received: from aegis (localhost [83.161.120.155]) by aegis.apache.org (Postfix) with ESMTP id CA1B7C003F for <michael48@example.com>; Fri, 1 Apr 2011 16:01:07 +0000 (UTC) Date: Fri, 1 Apr 2011 16:01:07 +0000 (UTC) From: Apache Hudson Server <michael48@example.com> To: michael48@example.com Message-ID: <1862192199.12941301673667809.JavaMail.hudson@aegis> Subject: Build failed in Jenkins: Tika-trunk #505 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Virus-Checked: Checked by ClamAV on apache.org See <https://hudson.apache.org/hudson/job/Tika-trunk/505/changes> Changes: [nick] TIKA-631 - Stub out the work for improving the outlook parsing WRT h= tml body content and better encoding detection [nick] TIKA-631 - Sample Chinese outlook file ------------------------------------------ Started by an SCM change Building remotely on ubuntu1 Updating http://svn.apache.org/repos/asf/tika/trunk U tika-parsers/src/test/java/org/apache/tika/mime/TestMimeTypes.jav= a AU tika-parsers/src/test/resources/test-documents/testMSG_chinese.ms= g AU tika-parsers/src/test/resources/test-documents/testWMV.wmv AU tika-parsers/src/test/resources/test-documents/testASF.asf AU tika-parsers/src/test/resources/test-documents/testWMA.wma U tika-parsers/src/main/java/org/apache/tika/parser/microsoft/Outlo= okExtractor.java U tika-core/src/main/java/org/apache/tika/mime/MimeTypesReader.java U tika-core/src/main/resources/org/apache/tika/mime/tika-mimetypes.= xml At revision 1087781 ERROR: Processing failed due to a bug in the code. Please report this to je= michael48@example.com java.lang.IllegalArgumentException: /home/hudson/tools/maven/latest3 withou= t lib directory =09at hudson.maven.MavenEmbedderUtils.buildClassRealm(MavenEmbedderUtils.ja= va:81) =09at hudson.maven.MavenEmbedderUtils.getMavenVersion(MavenEmbedderUtils.ja= va:170) =09at hudson.maven.MavenVersionCallable.call(MavenVersionCallable.java:56) =09at hudson.maven.MavenVersionCallable.call(MavenVersionCallable.java:40) =09at hudson.remoting.UserRequest.perform(UserRequest.java:114) =09at hudson.remoting.UserRequest.perform(UserRequest.java:48) =09at hudson.remoting.Request$2.run(Request.java:270) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:47= 1) =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) =09at java.util.concurrent.FutureTask.run(FutureTask.java:166) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1110) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:603) =09at java.lang.Thread.run(Thread.java:636) project=3Dhudson.maven.MavenModuleSet@2b204e1b[Tika-trunk] project.getModules()=3D[hudson.maven.MavenModule@c25cc4c[Tika-trunk/org.apa= che.tika:tika][Tika-trunk/org.apache.tika:tika][relativePath:], hudson.mave= n.MavenModule@18607df6[Tika-trunk/org.apache.tika:tika-app][Tika-trunk/org.= apache.tika:tika-app][relativePath:tika-app], hudson.maven.MavenModule@2464= a693[Tika-trunk/org.apache.tika:tika-bundle][Tika-trunk/org.apache.tika:tik= a-bundle][relativePath:tika-bundle], hudson.maven.MavenModule@2648b938[Tika= -trunk/org.apache.tika:tika-core][Tika-trunk/org.apache.tika:tika-core][rel= ativePath:tika-core], hudson.maven.MavenModule@226c955e[Tika-trunk/org.apac= he.tika:tika-full][Tika-trunk/org.apache.tika:tika-full][relativePath:tika-= full], hudson.maven.MavenModule@7851576a[Tika-trunk/org.apache.tika:tika-pa= rent][Tika-trunk/org.apache.tika:tika-parent][relativePath:tika-parent], hu= dson.maven.MavenModule@1d5bd19e[Tika-trunk/org.apache.tika:tika-parsers][Ti= ka-trunk/org.apache.tika:tika-parsers][relativePath:tika-parsers], hudson.m= aven.MavenModule@795eac8b[Tika-trunk/org.apache.tika:tika-reactor][Tika-tru= nk/org.apache.tika:tika-reactor][relativePath:], hudson.maven.MavenModule@5= ab49cf1[Tika-trunk/org.apache.tika:tika-server][Tika-trunk/org.apache.tika:= tika-server][relativePath:tika-server]] project.getRootModule()=3Dhudson.maven.MavenModule@c25cc4c[Tika-trunk/org.a= pache.tika:tika][Tika-trunk/org.apache.tika:tika][relativePath:] FATAL: /home/hudson/tools/maven/latest3 without lib directory java.lang.IllegalArgumentException: /home/hudson/tools/maven/latest3 withou= t lib directory =09at hudson.maven.MavenEmbedderUtils.buildClassRealm(MavenEmbedderUtils.ja= va:81) =09at hudson.maven.MavenEmbedderUtils.getMavenVersion(MavenEmbedderUtils.ja= va:170) =09at hudson.maven.MavenVersionCallable.call(MavenVersionCallable.java:56) =09at hudson.maven.MavenVersionCallable.call(MavenVersionCallable.java:40) =09at hudson.remoting.UserRequest.perform(UserRequest.java:114) =09at hudson.remoting.UserRequest.perform(UserRequest.java:48) =09at hudson.remoting.Request$2.run(Request.java:270) =09at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:47= 1) =09at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334) =09at java.util.concurrent.FutureTask.run(FutureTask.java:166) =09at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.= java:1110) =09at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor= .java:603) =09at java.lang.Thread.run(Thread.java:636) From michael48@example.com Fri Apr 01 16:15:44 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 50596 invoked from network); 1 Apr 2011 16:15:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 16:15:44 -0000 Received: (qmail 25168 invoked by uid 500); 1 Apr 2011 16:15:44 -0000 Delivered-To: michael48@example.com Received: (qmail 25139 invoked by uid 500); 1 Apr 2011 16:15:44 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 25127 invoked by uid 99); 1 Apr 2011 16:15:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:15:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:15:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 572F78E63F for <michael48@example.com>; Fri, 1 Apr 2011 16:15:06 +0000 (UTC) Date: Fri, 1 Apr 2011 16:15:06 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Updated] (TIKA-632) Rtf parsing ignores links MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TIKA-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Burch updated TIKA-632: ---------------------------- Attachment: test.rtf > Rtf parsing ignores links > ------------------------- > > Key: TIKA-632 > URL: https://issues.apache.org/jira/browse/TIKA-632 > Project: Tika > Issue Type: Bug > Components: parser > Affects Versions: 0.9 > Reporter: Nick Burch > Attachments: test.rtf > > > I spotted this while working on TIKA-631 - an RTF file containing links has the link skipped over - neither the link text nor the link href are output. > In the attached sample file (which is the RTF contents of /test-documents/test-outlook2003.msg), we should see things like: > [a href="http://r.office.microsoft.com/r/rlidOutlookWelcomeMail1?clid=1033">Streamlined Mail Experience[/a> - Outlook > Instead, all we get is " - Outlook" -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Fri Apr 01 16:15:47 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 50734 invoked from network); 1 Apr 2011 16:15:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 16:15:46 -0000 Received: (qmail 25488 invoked by uid 500); 1 Apr 2011 16:15:46 -0000 Delivered-To: michael48@example.com Received: (qmail 25452 invoked by uid 500); 1 Apr 2011 16:15:46 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 25381 invoked by uid 99); 1 Apr 2011 16:15:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:15:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:15:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 494A08E63D for <michael48@example.com>; Fri, 1 Apr 2011 16:15:06 +0000 (UTC) Date: Fri, 1 Apr 2011 16:15:06 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> Subject: [jira] [Created] (TIKA-632) Rtf parsing ignores links MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org Rtf parsing ignores links ------------------------- Key: TIKA-632 URL: https://issues.apache.org/jira/browse/TIKA-632 Project: Tika Issue Type: Bug Components: parser Affects Versions: 0.9 Reporter: Nick Burch Attachments: test.rtf I spotted this while working on TIKA-631 - an RTF file containing links has the link skipped over - neither the link text nor the link href are output. In the attached sample file (which is the RTF contents of /test-documents/test-outlook2003.msg), we should see things like: [a href="http://r.office.microsoft.com/r/rlidOutlookWelcomeMail1?clid=1033">Streamlined Mail Experience[/a> - Outlook Instead, all we get is " - Outlook" -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Fri Apr 01 16:17:44 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 55664 invoked from network); 1 Apr 2011 16:17:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 16:17:44 -0000 Received: (qmail 28369 invoked by uid 500); 1 Apr 2011 16:17:44 -0000 Delivered-To: michael48@example.com Received: (qmail 28331 invoked by uid 500); 1 Apr 2011 16:17:44 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 28323 invoked by uid 99); 1 Apr 2011 16:17:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:17:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:17:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 80A2E8E6F8 for <michael48@example.com>; Fri, 1 Apr 2011 16:17:06 +0000 (UTC) Date: Fri, 1 Apr 2011 16:17:06 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Updated] (TIKA-631) Improve handling of Outlook emails which contain html, and those with non-unicode text bodies MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TIKA-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Burch updated TIKA-631: ---------------------------- Attachment: OutlookRTFStub.patch The attached patch OutlookRTFStub.patch requires POI 3.8 beta 2, and fetches the RTF message body. It isn't used though, pending TIKA-632 > Improve handling of Outlook emails which contain html, and those with non-unicode text bodies > --------------------------------------------------------------------------------------------- > > Key: TIKA-631 > URL: https://issues.apache.org/jira/browse/TIKA-631 > Project: Tika > Issue Type: Improvement > Components: parser > Affects Versions: 0.9 > Reporter: Nick Burch > Assignee: Nick Burch > Attachments: OutlookRTFStub.patch > > > There are two areas in the outlook parsing that could use some enhancement: > * If the text content is stored as non unicode strings, we should try to have the right encoding used for this > * If the email contains a html or rtf version of the message body, we should prefer this over the plain text one > Note - some of these enhancements may need to wait for POI 3.8 beta 3 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Fri Apr 01 16:37:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 42687 invoked from network); 1 Apr 2011 16:37:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 1 Apr 2011 16:37:46 -0000 Received: (qmail 69000 invoked by uid 500); 1 Apr 2011 16:37:45 -0000 Delivered-To: michael48@example.com Received: (qmail 68972 invoked by uid 500); 1 Apr 2011 16:37:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 68960 invoked by uid 99); 1 Apr 2011 16:37:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:37:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 01 Apr 2011 16:37:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B17AD8EBE2 for <michael48@example.com>; Fri, 1 Apr 2011 16:37:05 +0000 (UTC) Date: Fri, 1 Apr 2011 16:37:05 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Updated] (TIKA-631) Improve handling of Outlook emails which contain html, and those with non-unicode text bodies MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nick Burch updated TIKA-631: ---------------------------- Attachment: OutlookHtmlRtf.patch OutlookHtmlRtf.patch requires POI 3.8 beta 3, but enables the use of the HTML part in preference to the plain text one One thing though - is there a trick to only have the body part of the nested html output when delegating to the Html Parser part way through? > Improve handling of Outlook emails which contain html, and those with non-unicode text bodies > --------------------------------------------------------------------------------------------- > > Key: TIKA-631 > URL: https://issues.apache.org/jira/browse/TIKA-631 > Project: Tika > Issue Type: Improvement > Components: parser > Affects Versions: 0.9 > Reporter: Nick Burch > Assignee: Nick Burch > Attachments: OutlookHtmlRtf.patch, OutlookRTFStub.patch > > > There are two areas in the outlook parsing that could use some enhancement: > * If the text content is stored as non unicode strings, we should try to have the right encoding used for this > * If the email contains a html or rtf version of the message body, we should prefer this over the plain text one > Note - some of these enhancements may need to wait for POI 3.8 beta 3 -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sat Apr 02 16:14:47 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 89158 invoked from network); 2 Apr 2011 16:14:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Apr 2011 16:14:46 -0000 Received: (qmail 41143 invoked by uid 500); 2 Apr 2011 16:14:46 -0000 Delivered-To: michael48@example.com Received: (qmail 41117 invoked by uid 500); 2 Apr 2011 16:14:46 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 41109 invoked by uid 99); 2 Apr 2011 16:14:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:14:46 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:14:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 03B688FAD4 for <michael48@example.com>; Sat, 2 Apr 2011 16:14:06 +0000 (UTC) Date: Sat, 2 Apr 2011 16:14:06 +0000 (UTC) From: "Richard Johnson (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015043#comment-13015043 ] Richard Johnson commented on TIKA-623: -------------------------------------- Hey Guys, I've just uploaded a new version with some cleanups, bug fixes and most importantly a new License. Kind Regards, Richard > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sat Apr 02 16:22:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 14628 invoked from network); 2 Apr 2011 16:22:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Apr 2011 16:22:45 -0000 Received: (qmail 42918 invoked by uid 500); 2 Apr 2011 16:22:45 -0000 Delivered-To: michael48@example.com Received: (qmail 42892 invoked by uid 500); 2 Apr 2011 16:22:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 42883 invoked by uid 99); 2 Apr 2011 16:22:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:22:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:22:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B44778FC01 for <michael48@example.com>; Sat, 2 Apr 2011 16:22:05 +0000 (UTC) Date: Sat, 2 Apr 2011 16:22:05 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015045#comment-13015045 ] Nick Burch commented on TIKA-623: --------------------------------- Great news Richard. Are you happy to start the process of getting the new release into Maven Central? The process should be largely the same as Ken did with TIKA-462, and Sonatype seem to have a very handy walkthrough of the process at https://docs.sonatype.org/display/Repository/Sonatype+OSS+Maven+Repository+Usage+Guide > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sat Apr 02 16:30:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 37429 invoked from network); 2 Apr 2011 16:30:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Apr 2011 16:30:46 -0000 Received: (qmail 44232 invoked by uid 500); 2 Apr 2011 16:30:45 -0000 Delivered-To: michael48@example.com Received: (qmail 44198 invoked by uid 500); 2 Apr 2011 16:30:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 44190 invoked by uid 99); 2 Apr 2011 16:30:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:30:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:30:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B70CC8FD1D for <michael48@example.com>; Sat, 2 Apr 2011 16:30:05 +0000 (UTC) Date: Sat, 2 Apr 2011 16:30:05 +0000 (UTC) From: "Tran Nam Quang (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015046#comment-13015046 ] Tran Nam Quang commented on TIKA-623: ------------------------------------- Cool! I'll start writing the Tika parser as soon as I can. Could take a couple of days though. Richard, I have one question regarding the API: PSTMessage has two methods, getDescriptorNodeId() and getInternetMessageId(). Both return identifiers, apparently. My question is: Which one is an unique identifier that will never, ever change? Cause I wouldn't want the Tika parser to extract identifiers that are "internal-only" and not unique. > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sat Apr 02 16:32:43 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 49955 invoked from network); 2 Apr 2011 16:32:43 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 2 Apr 2011 16:32:43 -0000 Received: (qmail 44720 invoked by uid 500); 2 Apr 2011 16:32:43 -0000 Delivered-To: michael48@example.com Received: (qmail 44686 invoked by uid 500); 2 Apr 2011 16:32:43 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 44678 invoked by uid 99); 2 Apr 2011 16:32:43 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:32:43 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sat, 02 Apr 2011 16:32:42 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B79E48FD8B for <michael48@example.com>; Sat, 2 Apr 2011 16:32:05 +0000 (UTC) Date: Sat, 2 Apr 2011 16:32:05 +0000 (UTC) From: "Tran Nam Quang (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Issue Comment Edited] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015046#comment-13015046 ] Tran Nam Quang edited comment on TIKA-623 at 4/2/11 4:30 PM: ------------------------------------------------------------- Cool! I'll start writing the Tika parser as soon as I can. Could take a couple of days though. Richard, I have one question regarding the API: PSTMessage has two methods, getDescriptorNodeId() and getInternetMessageId(). Both return identifiers, apparently. My question is: Which one is an unique identifier that will never, ever change? Cause I wouldn't want the Tika parser to extract identifiers that are "internal-only" and not unique. Btw, maybe it's a good idea to also clarify this in the Javadoc. was (Author: qforce): Cool! I'll start writing the Tika parser as soon as I can. Could take a couple of days though. Richard, I have one question regarding the API: PSTMessage has two methods, getDescriptorNodeId() and getInternetMessageId(). Both return identifiers, apparently. My question is: Which one is an unique identifier that will never, ever change? Cause I wouldn't want the Tika parser to extract identifiers that are "internal-only" and not unique. > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 14:24:47 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 54362 invoked from network); 3 Apr 2011 14:24:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 14:24:46 -0000 Received: (qmail 36134 invoked by uid 500); 3 Apr 2011 14:24:46 -0000 Delivered-To: michael48@example.com Received: (qmail 36055 invoked by uid 500); 3 Apr 2011 14:24:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 36047 invoked by uid 99); 3 Apr 2011 14:24:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 14:24:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 14:24:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B242A90607 for <michael48@example.com>; Sun, 3 Apr 2011 14:24:05 +0000 (UTC) Date: Sun, 3 Apr 2011 14:24:05 +0000 (UTC) From: "Tran Nam Quang (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015152#comment-13015152 ] Tran Nam Quang commented on TIKA-623: ------------------------------------- I started work on the Tika parser, but got stuck with the following problem: In order to access the Outlook PST file, I need to create a PSTFile instance. Now, the PSTFile constructor requires either a File or a String argument that points at the PST file. The constructor then takes either of these to create a RandomAccessFile internally. However, Tika's Parser interface gives me an InputStream. What do I do? > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 14:26:49 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 62420 invoked from network); 3 Apr 2011 14:26:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 14:26:46 -0000 Received: (qmail 40287 invoked by uid 500); 3 Apr 2011 14:26:45 -0000 Delivered-To: michael48@example.com Received: (qmail 40247 invoked by uid 500); 3 Apr 2011 14:26:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 40239 invoked by uid 99); 3 Apr 2011 14:26:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 14:26:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 14:26:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id B508A90664 for <michael48@example.com>; Sun, 3 Apr 2011 14:26:05 +0000 (UTC) Date: Sun, 3 Apr 2011 14:26:05 +0000 (UTC) From: "Tran Nam Quang (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Issue Comment Edited] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015152#comment-13015152 ] Tran Nam Quang edited comment on TIKA-623 at 4/3/11 2:25 PM: ------------------------------------------------------------- I started work on the Tika parser, but got stuck with the following problem: In order to access the Outlook PST file, I need to create a PSTFile instance. Now, the PSTFile constructor requires either a File or a String argument that points at the PST file. The constructor then takes either of these arguments to create a RandomAccessFile internally. However, Tika's Parser interface gives me an InputStream. What do I do? was (Author: qforce): I started work on the Tika parser, but got stuck with the following problem: In order to access the Outlook PST file, I need to create a PSTFile instance. Now, the PSTFile constructor requires either a File or a String argument that points at the PST file. The constructor then takes either of these to create a RandomAccessFile internally. However, Tika's Parser interface gives me an InputStream. What do I do? > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 15:06:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 18608 invoked from network); 3 Apr 2011 15:06:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 15:06:46 -0000 Received: (qmail 65662 invoked by uid 500); 3 Apr 2011 15:06:46 -0000 Delivered-To: michael48@example.com Received: (qmail 65580 invoked by uid 500); 3 Apr 2011 15:06:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 65572 invoked by uid 99); 3 Apr 2011 15:06:45 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 15:06:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 15:06:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id CD26F90C8E for <michael48@example.com>; Sun, 3 Apr 2011 15:06:05 +0000 (UTC) Date: Sun, 3 Apr 2011 15:06:05 +0000 (UTC) From: "Nick Burch (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015158#comment-13015158 ] Nick Burch commented on TIKA-623: --------------------------------- Tran - wrap it in a TikaInputStream, which handles converting between Files and InputStreams as required by the underlying libraries. > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 15:32:45 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 98072 invoked from network); 3 Apr 2011 15:32:45 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 15:32:45 -0000 Received: (qmail 71412 invoked by uid 500); 3 Apr 2011 15:32:45 -0000 Delivered-To: michael48@example.com Received: (qmail 71383 invoked by uid 500); 3 Apr 2011 15:32:45 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 71375 invoked by uid 99); 3 Apr 2011 15:32:45 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 15:32:45 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 15:32:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id A1831900B6 for <michael48@example.com>; Sun, 3 Apr 2011 15:32:07 +0000 (UTC) Date: Sun, 3 Apr 2011 15:32:07 +0000 (UTC) From: "Richard Johnson (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015160#comment-13015160 ] Richard Johnson commented on TIKA-623: -------------------------------------- getDescriptorNodeId() is most likely the one you want for a unique identifier. They are for internal use, however they are guaranteed unique per PST file and are unchanging (incrementally allocated and not reused). Internet Message Ids are the ones from rfc2822, and therefore not all PST objects (such as unsent emails) have them. I'll get this updated in the javadocs. > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 16:00:50 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 78679 invoked from network); 3 Apr 2011 16:00:49 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 16:00:49 -0000 Received: (qmail 78357 invoked by uid 500); 3 Apr 2011 16:00:49 -0000 Delivered-To: michael48@example.com Received: (qmail 78321 invoked by uid 500); 3 Apr 2011 16:00:49 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 78313 invoked by uid 99); 3 Apr 2011 16:00:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:00:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:00:47 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 9000C90576 for <michael48@example.com>; Sun, 3 Apr 2011 16:00:09 +0000 (UTC) Date: Sun, 3 Apr 2011 16:00:09 +0000 (UTC) From: "Richard Johnson (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015164#comment-13015164 ] Richard Johnson commented on TIKA-623: -------------------------------------- I'll start working on getting the library into Maven Central, thanks for those links Nick. > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Sun Apr 03 16:07:46 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 27526 invoked from network); 3 Apr 2011 16:07:46 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 16:07:46 -0000 Received: (qmail 81148 invoked by uid 500); 3 Apr 2011 16:07:46 -0000 Delivered-To: michael48@example.com Received: (qmail 81121 invoked by uid 500); 3 Apr 2011 16:07:46 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 81113 invoked by uid 99); 3 Apr 2011 16:07:46 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:07:46 +0000 X-ASF-Spam-Status: No, hits=1.5 required=5.0 tests=FREEMAIL_FROM,HTML_MESSAGE,RCVD_IN_DNSWL_LOW,SPF_PASS,T_TO_NO_BRKTS_FREEMAIL X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of michael48@example.com designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO mail-bw0-f54.google.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:07:40 +0000 Received: by bwz12 with SMTP id 12so4385399bwz.13 for <michael48@example.com>; Sun, 03 Apr 2011 09:07:19 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:in-reply-to:references:date :message-id:subject:from:to:content-type; bh=YGN9D/fng0s4oVjeDkhyHJFcV6nrNRgbjRHug8B+bAw=; b=LMzhZ1sWFRxTHmHorpuYBdpm0y1VGsvWx6t17JgysfwyuKcMj4n2KjLNzwBynFoFrt j1O9lOS1YpXIc4aOvu7wlEsVEG+ZtqZ4tlh1EecSAaaZOxGauNY3ShO9xcGvrrVtOqsC 71jTbrlmS2P3FPXGSQvYTzd/eQ0ecj5ZaPa0g= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; b=houDGt9Wr9/2t8VI37l2FG9vjvgovqE+pC+k+CyooSttmvmTVWc8m4HRcGIanvN5NZ cv5iE+xd5vmTxiB5eITHWG20GV1rddITmGrSlbItf+DjpDIL3DE3LG6yUBkRJUshAPpM WY8jmi4PqnBIxeR+hc1/anGoUxXJOpxymTgGI= MIME-Version: 1.0 Received: by 83.161.120.155 with SMTP id k11mr5343933bka.49.1301846839590; Sun, 03 Apr 2011 09:07:19 -0700 (PDT) Received: by 83.161.120.155 with HTTP; Sun, 3 Apr 2011 09:07:19 -0700 (PDT) In-Reply-To: <michael48@example.com> References: <michael48@example.com> <michael48@example.com> Date: Sun, 3 Apr 2011 19:07:19 +0300 Message-ID: <michael48@example.com> Subject: Re: [jira] [Issue Comment Edited] (TIKA-623) Add support for Outlook PST From: Oleg Tikhonov <michael48@example.com> To: michael48@example.com Content-Type: multipart/alternative; boundary=00032555a2226cff6704a005d69e X-Virus-Checked: Checked by ClamAV on apache.org --00032555a2226cff6704a005d69e Content-Type: text/plain; charset=ISO-8859-1 One of the possible solutions is to create temporary file, pass it to the citor and delete it after using. OutputStream out = null; File tempFile = new File(tempPSTFileName); try { out = new FileOutputStream(tempFile); byte buf[] = new byte[1<<20]; int len; while ((len = inputStream.read(buf)) > 0) { out.write(buf, 0, len); } } catch (IOException e) { } finally { out.flush(); out.close(); if(inputStream != null && inputStream.available() > 0) inputStream.close(); } } //delete after tempFile.delete(); -or- tempFile.deleteOnExit(); BR, Oleg On Sun, Apr 3, 2011 at 5:26 PM, Tran Nam Quang (JIRA) <michael48@example.com>wrote: > > [ > https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015152#comment-13015152] > > Tran Nam Quang edited comment on TIKA-623 at 4/3/11 2:25 PM: > ------------------------------------------------------------- > > I started work on the Tika parser, but got stuck with the following > problem: In order to access the Outlook PST file, I need to create a PSTFile > instance. Now, the PSTFile constructor requires either a File or a String > argument that points at the PST file. The constructor then takes either of > these arguments to create a RandomAccessFile internally. However, Tika's > Parser interface gives me an InputStream. What do I do? > > was (Author: qforce): > I started work on the Tika parser, but got stuck with the following > problem: In order to access the Outlook PST file, I need to create a PSTFile > instance. Now, the PSTFile constructor requires either a File or a String > argument that points at the PST file. The constructor then takes either of > these to create a RandomAccessFile internally. However, Tika's Parser > interface gives me an InputStream. What do I do? > > > Add support for Outlook PST > > --------------------------- > > > > Key: TIKA-623 > > URL: https://issues.apache.org/jira/browse/TIKA-623 > > Project: Tika > > Issue Type: New Feature > > Components: parser > > Reporter: Tran Nam Quang > > > > Hello everyone, > > As you might know, Outlook stores its mails and other stuff in a single > PST file. There's a relatively new Java library called java-libpst for > reading Outlook PST files. It is licensed under the LGPL and available over > here: http://code.google.com/p/java-libpst/ > > I have tested the library on Outlook 2000 and Outlook 2003, with good > results. It would be great if the library could be integrated into Tika. > > Best regards > > Tran Nam Quang > > -- > This message is automatically generated by JIRA. > For more information on JIRA, see: http://www.atlassian.com/software/jira > --00032555a2226cff6704a005d69e-- From michael48@example.com Sun Apr 03 16:36:44 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 22727 invoked from network); 3 Apr 2011 16:36:44 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 3 Apr 2011 16:36:44 -0000 Received: (qmail 99995 invoked by uid 500); 3 Apr 2011 16:36:44 -0000 Delivered-To: michael48@example.com Received: (qmail 99970 invoked by uid 500); 3 Apr 2011 16:36:44 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 99962 invoked by uid 99); 3 Apr 2011 16:36:44 -0000 Received: from athena.apache.org (HELO athena.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:36:44 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Sun, 03 Apr 2011 16:36:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 3923390CAA for <michael48@example.com>; Sun, 3 Apr 2011 16:36:06 +0000 (UTC) Date: Sun, 3 Apr 2011 16:36:06 +0000 (UTC) From: "Tran Nam Quang (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Commented] (TIKA-623) Add support for Outlook PST MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 [ https://issues.apache.org/jira/browse/TIKA-623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13015171#comment-13015171 ] Tran Nam Quang commented on TIKA-623: ------------------------------------- The PST file is basically a folder tree with emails and other stuff in it. Is there some sort of specification out there that tells me how to map this tree to specific XHTML elements? More specifically, what XML tags should I use to separate the emails from one another? And should the output be just a linear stream of emails, or should the tree structure be included in the output as well? > Add support for Outlook PST > --------------------------- > > Key: TIKA-623 > URL: https://issues.apache.org/jira/browse/TIKA-623 > Project: Tika > Issue Type: New Feature > Components: parser > Reporter: Tran Nam Quang > > Hello everyone, > As you might know, Outlook stores its mails and other stuff in a single PST file. There's a relatively new Java library called java-libpst for reading Outlook PST files. It is licensed under the LGPL and available over here: http://code.google.com/p/java-libpst/ > I have tested the library on Outlook 2000 and Outlook 2003, with good results. It would be great if the library could be integrated into Tika. > Best regards > Tran Nam Quang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Mon Apr 04 10:02:54 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 81647 invoked from network); 4 Apr 2011 10:02:54 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Apr 2011 10:02:54 -0000 Received: (qmail 60958 invoked by uid 500); 4 Apr 2011 10:02:54 -0000 Delivered-To: michael48@example.com Received: (qmail 60891 invoked by uid 500); 4 Apr 2011 10:02:54 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 60874 invoked by uid 99); 4 Apr 2011 10:02:53 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 10:02:53 +0000 X-ASF-Spam-Status: No, hits=-2.3 required=5.0 tests=RCVD_IN_DNSWL_MED,SPF_PASS X-Spam-Check-By: apache.org Received-SPF: pass (nike.apache.org: domain of michael48@example.com designates 83.161.120.155 as permitted sender) Received: from [83.161.120.155] (HELO exprod6og117.obsmtp.com) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 10:02:44 +0000 Received: from source ([83.161.120.155]) by exprod6ob117.postini.com ([83.161.120.155]) with SMTP ID michael48@example.com; Mon, 04 Apr 2011 03:02:23 PDT Received: from inner-relay-4.eur.adobe.com (inner-relay-4b [83.161.120.155]) by outbound-smtp-2.corp.adobe.com (8.12.10/8.12.10) with ESMTP id p34A2Jr1004828 for <michael48@example.com>; Mon, 4 Apr 2011 03:02:19 -0700 (PDT) Received: from nacas02.corp.adobe.com (nacas02.corp.adobe.com [83.161.120.155]) by inner-relay-4.eur.adobe.com (8.12.10/8.12.9) with ESMTP id p34A2I1R006087 for <michael48@example.com>; Mon, 4 Apr 2011 03:02:19 -0700 (PDT) Received: from eurhub01.eur.adobe.com (83.161.120.155) by nacas02.corp.adobe.com (83.161.120.155) with Microsoft SMTP Server (TLS) id 83.161.120.155; Mon, 4 Apr 2011 03:02:18 -0700 Received: from jzitting.adobe.com (83.161.120.155) by europemail.eur.adobe.com (83.161.120.155) with Microsoft SMTP Server (TLS) id 83.161.120.155; Mon, 4 Apr 2011 11:02:16 +0100 Message-ID: <michael48@example.com> Date: Mon, 4 Apr 2011 12:02:14 +0200 From: Jukka Zitting <michael48@example.com> Organization: Adobe User-Agent: Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:83.161.120.155) Gecko/20110307 Fedora/3.1.9-0.39.b3pre.fc14 Lightning/1.0b3pre Thunderbird/3.1.9 MIME-Version: 1.0 To: "michael48@example.com" <michael48@example.com> Subject: Re: [jira] [Issue Comment Edited] (TIKA-623) Add support for Outlook PST References: <michael48@example.com> <michael48@example.com> <michael48@example.com> In-Reply-To: <michael48@example.com> Content-Type: text/plain; charset="ISO-8859-1"; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Checked: Checked by ClamAV on apache.org Hi, On 04/03/2011 06:07 PM, Oleg Tikhonov wrote: > One of the possible solutions is to create temporary file, pass it to > the citor and delete it after using. As noted by Nick on the issue, a better alternative is to use TikaInputStream as it automatically takes care of creating and removing the temporary file if needed. The relevant code within a parse() method should look something like this: TemporaryFiles tmp = new TemporaryFiles(); try { TikaInputStream tis = TikaInputStream.get(stream, tmp); File file = tis.getFile(); ...; // process the file } finally { tmp.dispose(); } See the TikaInputStream and TemporaryFiles javadocs for the details. -- Jukka Zitting From michael48@example.com Mon Apr 04 14:04:50 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 92728 invoked from network); 4 Apr 2011 14:04:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Apr 2011 14:04:50 -0000 Received: (qmail 80470 invoked by uid 500); 4 Apr 2011 14:04:49 -0000 Delivered-To: michael48@example.com Received: (qmail 80429 invoked by uid 500); 4 Apr 2011 14:04:49 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 80421 invoked by uid 99); 4 Apr 2011 14:04:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 14:04:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 14:04:43 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 1AAC891C3E for <michael48@example.com>; Mon, 4 Apr 2011 14:04:06 +0000 (UTC) Date: Mon, 4 Apr 2011 14:04:06 +0000 (UTC) From: "Raimund Merkert (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> Subject: [jira] [Created] (TIKA-633) NPE in XWPFWordExtractorDecorator.extractHeaders MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org NPE in XWPFWordExtractorDecorator.extractHeaders ------------------------------------------------ Key: TIKA-633 URL: https://issues.apache.org/jira/browse/TIKA-633 Project: Tika Issue Type: Bug Components: parser Affects Versions: 0.9 Reporter: Raimund Merkert Attachments: Fails.docx I've got an word document (docx) that was written by POI-3.7 and I'm trying to read it back in and I'm getting this NPE: Caused by: michael48@example.com(XWPFWordExtractorDecorator.java:234) at org.apache.tika.parser.microsoft.ooxml.XWPFWordExtractorDecorator.buildXHTML(XWPFWordExtractorDecorator.java:71) at org.apache.tika.parser.microsoft.ooxml.AbstractOOXMLExtractor.getXHTML(AbstractOOXMLExtractor.java:99) at org.apache.tika.parser.microsoft.ooxml.OOXMLExtractorFactory.parse(OOXMLExtractorFactory.java:83) at org.apache.tika.parser.microsoft.ooxml.OOXMLParser.parse(OOXMLParser.java:67) at org.apache.tika.parser.CompositeParser.parse(CompositeParser.java:197) >From what I can see, a document may not necessarily have a headerfooterpolicy. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira From michael48@example.com Mon Apr 04 14:04:50 2011 Return-Path: <michael48@example.com> Delivered-To: michael48@example.com Received: (qmail 92756 invoked from network); 4 Apr 2011 14:04:50 -0000 Received: from hermes.apache.org (HELO mail.apache.org) (83.161.120.155) by minotaur.apache.org with SMTP; 4 Apr 2011 14:04:50 -0000 Received: (qmail 80612 invoked by uid 500); 4 Apr 2011 14:04:50 -0000 Delivered-To: michael48@example.com Received: (qmail 80558 invoked by uid 500); 4 Apr 2011 14:04:49 -0000 Mailing-List: contact michael48@example.com; run by ezmlm Precedence: bulk List-Help: <mailto:michael48@example.com> List-Unsubscribe: <mailto:michael48@example.com> List-Post: <mailto:michael48@example.com> List-Id: <dev.tika.apache.org> Reply-To: michael48@example.com Delivered-To: mailing list michael48@example.com Received: (qmail 80486 invoked by uid 99); 4 Apr 2011 14:04:49 -0000 Received: from nike.apache.org (HELO nike.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 14:04:49 +0000 X-ASF-Spam-Status: No, hits=-2000.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: apache.org Received: from [83.161.120.155] (HELO hel.zones.apache.org) (83.161.120.155) by apache.org (qpsmtpd/0.29) with ESMTP; Mon, 04 Apr 2011 14:04:44 +0000 Received: from hel.zones.apache.org (hel.zones.apache.org [83.161.120.155]) by hel.zones.apache.org (Postfix) with ESMTP id 92A7291C48 for <michael48@example.com>; Mon, 4 Apr 2011 14:04:06 +0000 (UTC) Date: Mon, 4 Apr 2011 14:04:06 +0000 (UTC) From: "Raimund Merkert (JIRA)" <michael48@example.com> To: michael48@example.com Message-ID: <michael48@example.com> In-Reply-To: <michael48@example.com> Subject: [jira] [Updated] (TIKA-633) NPE in XWPFWordExtractorDecorator.extractHeaders MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 X-Virus-Checked: Checked by ClamAV on apache.org [ https://issues.apache.org/jira/browse/TIKA-633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raimund Merkert updated TIKA-633: --------------------------------- Attachment: Fails.docx This document fails to be parsed. > NPE in XWPFWordExtractorDecorator.extractHeaders > ------------------------------------------------ > > Key: TIKA-633 > URL: https://issues.apache.org/jira/browse/TIKA-633
{'source': 'Apache Software Foundation Public Mail Archives'}