Foreign Characters in android & Java -

-

i trying download , parse webpage foreign (chinese) characters. i'm not sure whether should use "utf-8" or else. none of these seems work me. used sample wikitionary code geturlcontent().

public void oncreate(bundle savedinstancestate) {     super.oncreate(savedinstancestate);     setcontentview(r.layout.main);     mtext = (textview) findviewbyid(r.id.textview1);     huaren.prepareuseragent(this);     string test = new string("fail");      try {         test = geturlcontent("http://huaren.us/");     } catch (apiexception e) {         // todo auto-generated catch block         e.printstacktrace();     }     byte[] b = new byte[100000];      try {           b = test.getbytes("utf-8");     } catch (unsupportedencodingexception e) {         // todo auto-generated catch block         e.printstacktrace();     }      char[] chararr = (new string(b)).tochararray();     charsequence seq = java.nio.charbuffer.wrap(chararr);       mtext.settext(chararr, 0, 1000);//.settext(seq); }  protected static synchronized string geturlcontent(string url) throws apiexception {     if (suseragent == null) {         throw new apiexception("user-agent string must prepared");     }      // create client , set our specific user-agent string     httpclient client = new defaulthttpclient();     httpget request = new httpget(url);     request.setheader("user-agent", suseragent);      try {         httpresponse response = client.execute(request);          // check if server response valid         statusline status = response.getstatusline();         if (status.getstatuscode() != http_status_ok) {             throw new apiexception("invalid response server: " +                     status.tostring());         }          // pull content stream response         httpentity entity = response.getentity();         inputstream inputstream = entity.getcontent();          bytearrayoutputstream content = new bytearrayoutputstream();          // read response buffered stream         int readbytes = 0;         while ((readbytes = inputstream.read(sbuffer)) != -1) {             content.write(sbuffer, 0, readbytes);         }          // return result buffered stream         return new string(content.tobytearray(), "utf-8");     } catch (ioexception e) {         throw new apiexception("problem communicating api", e);     } }

the charset defined in the page itself:

<meta http-equiv="content-type" content="text/html; charset=gb2312" />

in general, there 3 ways specify encoding of http-server html page:

content-type header of http 

content-type: text/html; charset=utf-8

encoding pseudo-attribute in xml declaration

<?xml version="1.0" encoding="utf-8" ?>

meta tag inside head

<meta http-equiv="content-type" content="text/html;charset=utf-8" />

see character encodings details

so should try evaluate each possible declaration in order find appropriate encoding. try parse page utf-8 , restart if encounter content-type declaration meta tag.


Comments

Post a Comment

Popular posts from this blog

C#: Application without a window or taskbar item (background app) that can still use Console.WriteLine() -

-
i'm trying create application adheres following: no taskbar no console or form window can utilize console.writeline() . (i.e. if executes app command prompt write console.) the problem if create windows form (or wpf) application can have there no taskbar, console or window show up, console.writeline() nothing. if create console app, writes console, can't figure out how hide (and if did hide it, write command prompt window?)... how do this? just create standard console application. callers responsibility hide window caused program (from how run c# console application console hidden ): system.diagnostics.processstartinfo start = new system.diagnostics.processstartinfo(); start.filename = dir + @"\myprocesstostart.exe"; start.windowstyle = system.diagnostics.processwindowstyle.hidden;
Read more

c++ - Convert big endian to little endian when reading from a binary file -

-
this question has answer here: how convert between big-endian , little-endian values in c++? 28 answers i've been looking around how convert big-endian little-endians. didn't find solve problem. seem there's many way can conversion. anyway following code works ok in big-endian system. how should write conversion function work on little-endian system well? this homework, since systems @ school running big-endian system. it's got curious , wanted make work on home computer also #include <iostream> #include <fstream> using namespace std; int main() { ifstream file; file.open("file.bin", ios::in | ios::binary); if(!file) cerr << "not able read" << endl; else { cout << "opened" << endl; int i_var; double d_var; while(!file.eof()) {...
Read more

openssl - Load PKCS#8 binary key into Ruby -

-
i'm trying load particular private key encoded in binary der format ( pkcs#8 ) ruby. however, openssl::pkey won't recognize it. can make work doing console work , transforming pem so: openssl pkcs8 -inform der -in file.key -passin pass:xxxxxxxx >private_key.pem after this, key can correctly read. however, since whole process done in memory instead of writing , reading files. so question is: possible load private keys binary encoded der format ruby/openssl? thank time, fernando yes, can indirectly load pkcs#8 der-encoded private keys using ruby openssl. openssl::pkey::rsa.new handle pem-formatted pkcs#8, easy read binary der , convert pem-formatted string , load string. for example, these der-encoded private keys: $ openssl genrsa | openssl pkcs8 -topk8 -outform der \ -nocrypt -out pkcs8.key $ openssl genrsa | openssl pkcs8 -topk8 -outform der \ -v2 des3 -passout pass:secret -out pkcs8_des3.key you can this: require 'open...
Read more