haskell/encoding
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
52 Commits 3 Branches 23 Tags 793 KiB
b95bfe9be4
Commit Graph

52 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Henning Guenther
b95bfe9be4 JIS X 0208 encoding 
darcs-hash:20090223182459-a4fee-98ced8f8b7bac594dc6510eeecb6bea8c51a6090
 2009-02-23 10:24:59 -08:00
Henning Guenther
0398f66695 Remove Hack Warning 
darcs-hash:20090222183603-a4fee-b9435eb4652e49092c8c3b875e72006ff03b9de2
 2009-02-22 10:36:03 -08:00
Henning Guenther
9344038d33 JIS X 0201 encoding 
darcs-hash:20090222182246-a4fee-903520e4098e6809877fc55568207f40ebd6fda9
 2009-02-22 10:22:46 -08:00
Henning Guenther
d83074fa18 MacOS Roman encoding 
darcs-hash:20090222035756-a4fee-d2fef7a2c3317fbe9f25ab80bb6e156ceb0abf8a
 2009-02-21 19:57:56 -08:00
Henning Guenther
9e94c56aa0 Updated NEWS file for 0.5 
darcs-hash:20090222034200-a4fee-a3ded8b6ae57fc33637778fb4dce6f378fac1ae4
 2009-02-21 19:42:00 -08:00
Henning Guenther
eeee054f1e Rewrite to support more sources and changing the encoding dynamically 
Now it's possible to change the character encoding while de-/encoding.
Also, it's possible to use any data structure as a source or target of the de-/encoding process.

darcs-hash:20090221203100-a4fee-6da31f2e37c30a3f5cd5f10af71984209488bb0b
 2009-02-21 12:31:00 -08:00
Khudyakov Alexey
8b16078e5e Fix for KOI8-R and KOI8-U encodings 
Characters which should be encoded in [128..255] range were encoded into
[0..127] range.
** END OF DESCRIPTION***

Place the long patch description above the ***END OF DESCRIPTION*** marker.
The first line of this file will be the patch name.

This patch contains the following changes:

M ./Data/Encoding/KOI8R.hs -1 +1
M ./Data/Encoding/KOI8U.hs -1 +1

darcs-hash:20090118232224-7ba7e-c685a571f6ac9a9ca78725a80040e842f4a7e5a7
 2009-01-18 15:22:24 -08:00
Henning Guenther
2b9f9a87de Updated cabal version number to 0.4.1 
darcs-hash:20080517232203-a4fee-db1a5663e16f6ae825f0b5c13192209a90bd7c5a
 2008-05-17 16:22:03 -07:00
gaetan.lehmann
5eed326c08 Add the support for a large number of encoding name aliases. The aliases are the ones used in python, and are normalized as in python: they are case and separator insensitive. 
darcs-hash:20080514130514-2fc9d-1b53b11141878a8651f3bde7e427c877172e6722
 2008-05-14 06:05:14 -07:00
Henning Guenther
6405d95956 Added 'Build-Type' to cabal file 
As instructed by the lastest cabal release

darcs-hash:20080203133341-a4fee-0af681465e6aa0ee1967efd3266eecf7df364397
 2008-02-03 05:33:41 -08:00
Henning Guenther
3d6bf94b54 Changed cabal version number 
darcs-hash:20080203132637-a4fee-900de107fb793ce621a964ccd29cf478f91fef3e
 2008-02-03 05:26:37 -08:00
Henning Guenther
ccccfb7f66 Added changes for 0.4 
darcs-hash:20080203132339-a4fee-aad599be6f7a57b2f1ca98a0fb865bb3c61f8de2
 2008-02-03 05:23:39 -08:00
Henning Guenther
d5f4d60698 Made HPC analysis possible 
HPC doesn't like TemplateHaskell yet, so we have to comment things that require TemplateHaskell out using a preprocessor.

darcs-hash:20080203132156-a4fee-6587e14d7c57e0dfbc9f50746502e6b0a68b6632
 2008-02-03 05:21:56 -08:00
Henning Guenther
6c5011aaa3 Added KOI8U encoding 
darcs-hash:20080120213322-a4fee-752cc3f3ec4e7a01e5bbf93bad08a88ca3cb3a5b
 2008-01-20 13:33:22 -08:00
Henning Guenther
c201774307 Made Punycode tests more readable 
darcs-hash:20080120144023-a4fee-eb86482338c8eb86bca473cdb42d1446df90cc3c
 2008-01-20 06:40:23 -08:00
Henning Guenther
77d41d7cbb Added BootString tests 
darcs-hash:20080120013120-a4fee-4b40f1753d33ed12ac730b619ef26dd2e9d695a5
 2008-01-19 17:31:20 -08:00
Henning Guenther
42cdeecc96 Watch out for overflows in BootString 
darcs-hash:20080120013020-a4fee-282b60f860817f1f5994e4a867980d02f8020609
 2008-01-19 17:30:20 -08:00
Henning Guenther
8d740cf88a Refactored getT out of BootString 
darcs-hash:20080120010829-a4fee-7d617d76cc2e67b0e33662510c9736367396d2ea
 2008-01-19 17:08:29 -08:00
Henning Guenther
1510b86c10 BootString throws regular exceptions now 
darcs-hash:20080120005332-a4fee-9c09d47827db967d396c155a09cfa719d05f2c27
 2008-01-19 16:53:32 -08:00
Henning Guenther
3b9a84b979 Fixed BootString error 
darcs-hash:20080120002117-a4fee-6b3d8f1bc4dece6960c9319387f5fccca41620b4
 2008-01-19 16:21:17 -08:00
Henning Guenther
8b554f9369 Fixed confusing test output 
darcs-hash:20080120000022-a4fee-40ee6afa3b3d4d44dee7b2a5d03ce34ec226a5f3
 2008-01-19 16:00:22 -08:00
Henning Guenther
ce37d090af UTF16 test cases 
darcs-hash:20080119233135-a4fee-e9b4075c867089eb8d8608b7a03fdff75bf73240
 2008-01-19 15:31:35 -08:00
Henning Guenther
8b29980edb ASCII test cases 
darcs-hash:20080119233058-a4fee-e903ea97491b95c8278d925553b50589a906a7cd
 2008-01-19 15:30:58 -08:00
Henning Guenther
71c645029b Also test lazy encoding and decoding 
darcs-hash:20080119232950-a4fee-9fe600c6237f05b2e140733483f9b637a3c12812
 2008-01-19 15:29:50 -08:00
Henning Guenther
59a8526727 Better detection of UTF16 endianess 
darcs-hash:20080119232705-a4fee-ff06e72d08068de9566b37cbc3e31f1e944162ea
 2008-01-19 15:27:05 -08:00
Henning Guenther
529953686a Fixed UTF16 decoding error 
darcs-hash:20080116013924-a4fee-802818436b13cc8d3df5d772074a78cc685ccd10
 2008-01-15 17:39:24 -08:00
Henning Guenther
5a0a697cb8 Implemented UTF32BE and LE 
darcs-hash:20080115233419-a4fee-391b20ca239a6e59a6146f00ae084d0ff94ee908
 2008-01-15 15:34:19 -08:00
Henning Guenther
e849ef1404 More documentation for encodings 
darcs-hash:20080115224955-a4fee-339ceea9439723fa09096abab221f2ad735c8905
 2008-01-15 14:49:55 -08:00
Henning Guenther
38afec5701 Added encodingFromStringMaybe function 
darcs-hash:20080102150536-a4fee-163b2ff3d1e752be70ea8b2656e5346cacbf5d67
 2008-01-02 07:05:36 -08:00
Henning Guenther
a56e3cfb8a Made BootString instance of Show, Eq and Typeable 
darcs-hash:20080102145747-a4fee-af290555ad724b015336c8f08595ef95990877e6
 2008-01-02 06:57:47 -08:00
Henning Guenther
0e4f3e9d2b Made DynEncoding an instance of Eq 
darcs-hash:20080101224724-a4fee-4ff48f9729414a347da55cb95223429baf0587c1
 2008-01-01 14:47:24 -08:00
Henning Guenther
7490c4ae72 Added UTF-8 Unit Tests 
darcs-hash:20071231114752-a4fee-cd9e3941771199ed6e5930ad3bae48c69f064605
 2007-12-31 03:47:52 -08:00
Henning Guenther
82b0a26ec9 Implemented Unit Test Framework 
darcs-hash:20071231114727-a4fee-7bb01bb4f8b044c8cf29a84cb0f64a392c7f0588
 2007-12-31 03:47:27 -08:00
Henning Guenther
d1e1b3f5df Implemented a strict UTF8 decoder 
This means mainly not accepting overlong representations and not
allowing invalid bitmasks.

darcs-hash:20071231114623-a4fee-0006712f7f3e5db565b50d38eeb32674e063c49e
 2007-12-31 03:46:23 -08:00
Henning Guenther
7daec5bb6b Fixed UTF8 decoding bug 
There was an exception if trying to decode a sequence that had to have 4
bytes but had less.

darcs-hash:20071230234632-a4fee-d10fca90840b37952a5d4a4c31a1c8e4900f0f93
 2007-12-30 15:46:32 -08:00
Henning Guenther
971927c91f Made extensions explicit 
darcs-hash:20071229003551-a4fee-f01193be732b8f3f5085232f922490cd5b48706a
 2007-12-28 16:35:51 -08:00
Henning Guenther
49a11ab4f9 Documented changes for 0.3 
darcs-hash:20071210235730-a4fee-a09517a34f36dc3bcf6c533548f06418d22ac19a
 2007-12-10 15:57:30 -08:00
Henning Guenther
7e291fcefe Convert to new cabal and bytestring interfaces 
darcs-hash:20071210234921-a4fee-251367abbc4d99d72f425b2d1b69ce2c36f32572
 2007-12-10 15:49:21 -08:00
Henning Guenther
5b02009636 Removed dependence on Data.ByteString.Internal 
darcs-hash:20071105215225-a4fee-c0b55a368ffc296c7c784156f8340cb4586f1444
 2007-11-05 13:52:25 -08:00
Henning Guenther
6b82f1bb71 Changed UTF16 to support big/little endian encoding 
darcs-hash:20071105213105-a4fee-f3d5a91bee421e5e6c2d1d44787a421bb2d07b72
 2007-11-05 13:31:05 -08:00
Henning Guenther
cb81698b7e Derived all encodings from Show 
This way, we can declare DynEncoding an instance of Show

darcs-hash:20070827020833-a4fee-a84635bf911573022b780c17b2085ff814302b3e
 2007-08-26 19:08:33 -07:00
Henning Guenther
ece4c7e788 Added recode helper functions 
darcs-hash:20070827015125-a4fee-4be7dd71426674c5896aa309aa7c2e502a08a362
 2007-08-26 18:51:25 -07:00
Henning Guenther
59bc5d4305 Bumped version to 0.2 
Also made "sdist" work through a work-around.

darcs-hash:20070823124911-a4fee-df091bf2de6c016b39499a25b125b14fc2d2a0b2
 2007-08-23 05:49:11 -07:00
Henning Guenther
b2f9ebf564 Added NEWS file 
darcs-hash:20070823124723-a4fee-f268a2e32a543bd8a5b9b4f3eb76b1c8ddf6dba1
 2007-08-23 05:47:23 -07:00
Henning Guenther
1e3524e478 Added Template Haskell helper functions 
darcs-hash:20070823120526-a4fee-4d3fcf18768f5be81a81309d003f991c269ca136
 2007-08-23 05:05:26 -07:00
Henning Guenther
dc47984bf6 Implemented GB18030 encoding 
This is a bit of a hack, because the static lookup data this encoding requires brings template haskell to it's knees. So I've got a program that generates a haskell module file from the XML mapping.

darcs-hash:20070823034759-a4fee-883359c8951d4376fc2d783cd7be352d6c5b2111
 2007-08-22 20:47:59 -07:00
Henning Guenther
f069504db0 Work-around for windows-platforms 
getSystemEncoding will always return "ASCII" on windows. If you know a replacement for langinfo.h on windows, please tell me.

darcs-hash:20070813123558-a4fee-ec2f0f39494b005f8ae30fa7f0c2862cfa77695d
 2007-08-13 05:35:58 -07:00
Henning Guenther
b989f15063 Fixed issue with system_encoding.h not installing 
darcs-hash:20070813115953-a4fee-bc72c4d866a7f773d7414092f73013d211f6ae74
 2007-08-13 04:59:53 -07:00
Henning Guenther
49157ce910 changed case of name to match Hackage convention 
darcs-hash:20070802100257-a4fee-25c5ca462e6743615f0b52681f38e9846066d822
 2007-08-02 03:02:57 -07:00
Henning Guenther
9764bac998 Set homepage in cabal-file 
darcs-hash:20070802095742-a4fee-ac95805e5fdc433ba76c5b2467f54b2034ee1358
 2007-08-02 02:57:42 -07:00