haskell/encoding
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
111 Commits 3 Branches 23 Tags 793 KiB
23ae31d2a1
Commit Graph

67 Commits

Author SHA1 Message Date
Henning Guenther
9a7f52ab7a Fix compilation with mtl-2 
Ignore-this: 867097705abf2d63e427858078720dc4
This took really long, sorry everybody :/

darcs-hash:20110403123836-a4fee-c6af95e58267ca7e215e24bee250d0bbae13a1d4
 2011-04-03 05:38:36 -07:00
Daniel Wagner
a3a24776a3 let D.E.ASCII conform to the spec 
Ignore-this: 788eb99b3948ce201769471919562114

The contract for the "encodeable" function says, in part, "If it yields False,
encodeChar must throw an exception.". This patch makes the ASCII encoding
instance throw an exception for non-ASCII characters.

darcs-hash:20100909222914-76d51-76d9891ae18f13751b004e2b6ed24401192ae79f
 2010-09-09 15:29:14 -07:00
Henning Guenther
87dbb737ed Fix encoding range of UTF16 
Ignore-this: 444de9225bcb43b6af883a9cdf5f352a
Found due to better QuickCheck properties

darcs-hash:20100214220255-a4fee-56b8388a1379774f3603405e144cdedead4a2edc
 2010-02-14 14:02:55 -08:00
Henning Guenther
7b887abcb1 Fix bang pattern warning 
Ignore-this: 25c92a74956ada02b849a5bdb56f78c1

darcs-hash:20100214211452-a4fee-22d79ad1175d6d8728b2c9ba438a44ff891aa69f
 2010-02-14 13:14:52 -08:00
Henning Guenther
871b207ab2 Tuple instances for StaticElement 
Ignore-this: 50d3356bb845ae964e3a4b45cac0235d

darcs-hash:20090829135510-a4fee-131e4610a14dbd1b9f6d17aa65f41e2b5458311e
 2009-08-29 06:55:10 -07:00
Henning Guenther
f7b6c800ef Generate fancy translation table for documentation 
Ignore-this: 353d70985d048216dcf4522ceef10c26

darcs-hash:20090829131955-a4fee-c9e694757edc00d61e4a4365ef1fe2b0aeb948e8
 2009-08-29 06:19:55 -07:00
Henning Guenther
85394f42d2 Remove bogus documentation from ISO modules 
Ignore-this: a81365c812029787ddc46e9b6d597e5d

darcs-hash:20090829131726-a4fee-03bd97dfe38876c7c41039f5dc27a54a71ed7755
 2009-08-29 06:17:26 -07:00
Henning Guenther
b12649a071 Allow for documentation on mapping files 
Ignore-this: 5bcfdd21c16464e29fb7498dd6ec8915
Use the first commented lines in each mapping file as the docstring for the whole module.

darcs-hash:20090829125423-a4fee-c99efd2cccdaa24d3b283aca0d43cd7ff6970c7f
 2009-08-29 05:54:23 -07:00
Henning Guenther
56867f5768 Add warning about auto-generated files 
Ignore-this: 848d57a87bb839738cb055ff578b4784

darcs-hash:20090829121624-a4fee-b98f311f8e3358d3185d8cf9a796458ef234e2a7
 2009-08-29 05:16:24 -07:00
Henning Guenther
98ece426d9 Document Encoding base classes 
Ignore-this: 6a7f57460edd3a888d5f214c9aa115b

darcs-hash:20090828223146-a4fee-0e54f4127ceef0ddc6bfd938813b030d5b2faf19
 2009-08-28 15:31:46 -07:00
Henning Guenther
94b3b3f7d9 Various MSDOS copepages added 
Ignore-this: 6adc7c3ba146e7c41d3178241c173751

darcs-hash:20090828222844-a4fee-08926d980f1ffc4287b992a528855d03dd2d7bed
 2009-08-28 15:28:44 -07:00
Henning Guenther
2a2630625c Add Show instance for DynEncoding 
Ignore-this: 358ed8859aebfc1e9493150fbec0ff40

darcs-hash:20090828213441-a4fee-83066014b6a8b4d92c41c8bda7a36ea5c141673b
 2009-08-28 14:34:41 -07:00
Henning Guenther
6f3c147f8d Added missing Data.Static 
Ignore-this: 1bea98c16d73c055f608e8e2ea7b99d0

darcs-hash:20090813050306-a4fee-8fa3d698cffaff03b58cd867a29d7d08d078fd42
 2009-08-12 22:03:06 -07:00
Henning Guenther
037505e3d6 Documentation for ISO8859-1 
Ignore-this: 2c8c38a574a39170f67a4f043406f081

darcs-hash:20090813043833-a4fee-65a4a6eba1ca3d6ad04b69ec9b9ce805edb8e302
 2009-08-12 21:38:33 -07:00
Henning Guenther
414adf4e7d Removed obsolete template code 
Ignore-this: d555a44d9f5cf27c03f7b5ddd3a6ef4a

darcs-hash:20090813043811-a4fee-6ce046900453472765daf718ffe5446cf65ce4e7
 2009-08-12 21:38:11 -07:00
Henning Guenther
73eefc2838 Removed obsolete import 
Ignore-this: 1dbf628a27fb6b26d38dbf30e17f3a5e

darcs-hash:20090813024342-a4fee-54437c7ba6ea62ac454a6d1d4dc31c721b227d9f
 2009-08-12 19:43:42 -07:00
Henning Guenther
39af34b0a3 Added Preprocessor for XML mappings and normal mappings 
Ignore-this: dc0902f526ceb99db528e14c9e3ad563

darcs-hash:20090813024109-a4fee-447c0ff194c227ed919d6eef0f7824e63276183e
 2009-08-12 19:41:09 -07:00
Henning Guenther
6101ee16ae Switch from Template-based code generating to text-based 
Ignore-this: f58ceb5e1068be132b0a67a851b096f4
This has two advantages:
1. TemplateHaskell is painfully slow. There, I said it.
2. TemplateHaskell doesn't yet support some extensions that can be usefull for this library. Specifically the MagicHash extension.

darcs-hash:20090813023321-a4fee-0da13d0da6454f6ba3bd111ed6b80268d9e1b45c
 2009-08-12 19:33:21 -07:00
Henning Guenther
1ad8755a80 Fix chr calling on big numbers in UTF8 
Ignore-this: 3a7650c4b75691b79b082db6bddd5b8b

darcs-hash:20090813022455-a4fee-1989c74eb7f7a9daa87f902da138c45185ea520e
 2009-08-12 19:24:55 -07:00
Daniel Wagner
4b8a0341ac export encodingFromStringMaybe (as encodingFromStringExplicit for consistency) 
Ignore-this: 93f0968658fbdcd66f8f352308ebb1d5

darcs-hash:20090730233821-76d51-9ee074434d3626ad1a49cc44678d937fdb8750ce
 2009-07-30 16:38:21 -07:00
Henning Guenther
46d5eb8efd Generalized column skipping in code tables 
Ignore-this: dbcc883c561f2f074dd4739387dd3f43

darcs-hash:20090306150105-a4fee-b4d441cd38c758c803732e0c74a86a53d8db9c28
 2009-03-06 07:01:05 -08:00
Henning Guenther
fb5111d7dc ISO2022JP encoding 
Ignore-this: fa857024fa249fff451f5c024962484e

darcs-hash:20090303125641-a4fee-ac96e5788bb6b3cdf61f2e19f4bd19ece710e24b
 2009-03-03 04:56:41 -08:00
Henning Guenther
7f65298d3a ISO2022 encoding 
Ignore-this: 6058e1ef5776d1cdf70c32e533252b5e

darcs-hash:20090303125452-a4fee-d9a0533bf8215100a923f6552775048c2844a240
 2009-03-03 04:54:52 -08:00
Henning Guenther
693010654c Added JISX0212 
Ignore-this: 731c592d836554408bd7350b20a623a3

darcs-hash:20090303125335-a4fee-48fb4fa694f42bae3ba57834c3e52966c414bb55
 2009-03-03 04:53:35 -08:00
Henning Guenther
53d723d61e Added MacOSRoman 
Ignore-this: 9e8a302ffb6510ac490e71274d831231

darcs-hash:20090303125116-a4fee-ab486e72484d1ab9ac33dedc0ab2150ad05d2714
 2009-03-03 04:51:16 -08:00
Henning Guenther
3270e03da1 Made decoding array lookup safe 
Ignore-this: 346535974ae363daf4ade7e22ed48ad7

darcs-hash:20090226144653-a4fee-42808f15a3bab3fa1712ab12d8b0cfb54ff96aad
 2009-02-26 06:46:53 -08:00
Henning Guenther
6eb2d51ee2 Decoding arrays are unboxed (thus strict) now 
darcs-hash:20090225075818-a4fee-f558e4bde484482e0987c8623c3b2ec54ac4e394
 2009-02-24 23:58:18 -08:00
Henning Guenther
3b3f042529 Fix case and indentation 
darcs-hash:20090225073306-a4fee-a93aac7f0d47124c91a6b0a4899e9a96649d009d
 2009-02-24 23:33:06 -08:00
Henning Guenther
c2899caa35 Added ISO 2022-JP string to names list 
darcs-hash:20090225073143-a4fee-ec84c9ab6d5baa030e204df92bc5f4450011f9f9
 2009-02-24 23:31:43 -08:00
Henning Guenther
0b18661553 Added JISX0208 encoding file 
darcs-hash:20090225040351-a4fee-c061eed83f2d97c98a4ed56e75f58c4bf0f9b057
 2009-02-24 20:03:51 -08:00
Henning Guenther
d12097c7a1 Removed useless comment 
darcs-hash:20090225040233-a4fee-16dcf1f9cbc42c7e379f8ba83cb5f16ff1832d2c
 2009-02-24 20:02:33 -08:00
Henning Guenther
7b2af16c03 Added fetchAhead function 
darcs-hash:20090225040209-a4fee-816a8cef5c9edeea5b35fd5fe75ca5b0ec36ee17
 2009-02-24 20:02:09 -08:00
Henning Guenther
5528bf1a55 Added encodeable function 
darcs-hash:20090225040044-a4fee-67753f6d651b18d5bd3a28340ea8f5d7ea7eb90d
 2009-02-24 20:00:44 -08:00
Henning Guenther
1543e75f50 Added Eq instance for DynEncoding 
This envolves adding the requirement, that every Encoding must also be an instance of Eq and Typeable to go into DynEncoding.

darcs-hash:20090225035150-a4fee-c7d902e28313929ee9ffe0c6a6b60d8ff4704ae9
 2009-02-24 19:51:50 -08:00
Henning Guenther
b95bfe9be4 JIS X 0208 encoding 
darcs-hash:20090223182459-a4fee-98ced8f8b7bac594dc6510eeecb6bea8c51a6090
 2009-02-23 10:24:59 -08:00
Henning Guenther
0398f66695 Remove Hack Warning 
darcs-hash:20090222183603-a4fee-b9435eb4652e49092c8c3b875e72006ff03b9de2
 2009-02-22 10:36:03 -08:00
Henning Guenther
9344038d33 JIS X 0201 encoding 
darcs-hash:20090222182246-a4fee-903520e4098e6809877fc55568207f40ebd6fda9
 2009-02-22 10:22:46 -08:00
Henning Guenther
d83074fa18 MacOS Roman encoding 
darcs-hash:20090222035756-a4fee-d2fef7a2c3317fbe9f25ab80bb6e156ceb0abf8a
 2009-02-21 19:57:56 -08:00
Henning Guenther
eeee054f1e Rewrite to support more sources and changing the encoding dynamically 
Now it's possible to change the character encoding while de-/encoding.
Also, it's possible to use any data structure as a source or target of the de-/encoding process.

darcs-hash:20090221203100-a4fee-6da31f2e37c30a3f5cd5f10af71984209488bb0b
 2009-02-21 12:31:00 -08:00
Khudyakov Alexey
8b16078e5e Fix for KOI8-R and KOI8-U encodings 
Characters which should be encoded in [128..255] range were encoded into
[0..127] range.
** END OF DESCRIPTION***

Place the long patch description above the ***END OF DESCRIPTION*** marker.
The first line of this file will be the patch name.

This patch contains the following changes:

M ./Data/Encoding/KOI8R.hs -1 +1
M ./Data/Encoding/KOI8U.hs -1 +1

darcs-hash:20090118232224-7ba7e-c685a571f6ac9a9ca78725a80040e842f4a7e5a7
 2009-01-18 15:22:24 -08:00
gaetan.lehmann
5eed326c08 Add the support for a large number of encoding name aliases. The aliases are the ones used in python, and are normalized as in python: they are case and separator insensitive. 
darcs-hash:20080514130514-2fc9d-1b53b11141878a8651f3bde7e427c877172e6722
 2008-05-14 06:05:14 -07:00
Henning Guenther
d5f4d60698 Made HPC analysis possible 
HPC doesn't like TemplateHaskell yet, so we have to comment things that require TemplateHaskell out using a preprocessor.

darcs-hash:20080203132156-a4fee-6587e14d7c57e0dfbc9f50746502e6b0a68b6632
 2008-02-03 05:21:56 -08:00
Henning Guenther
6c5011aaa3 Added KOI8U encoding 
darcs-hash:20080120213322-a4fee-752cc3f3ec4e7a01e5bbf93bad08a88ca3cb3a5b
 2008-01-20 13:33:22 -08:00
Henning Guenther
42cdeecc96 Watch out for overflows in BootString 
darcs-hash:20080120013020-a4fee-282b60f860817f1f5994e4a867980d02f8020609
 2008-01-19 17:30:20 -08:00
Henning Guenther
8d740cf88a Refactored getT out of BootString 
darcs-hash:20080120010829-a4fee-7d617d76cc2e67b0e33662510c9736367396d2ea
 2008-01-19 17:08:29 -08:00
Henning Guenther
1510b86c10 BootString throws regular exceptions now 
darcs-hash:20080120005332-a4fee-9c09d47827db967d396c155a09cfa719d05f2c27
 2008-01-19 16:53:32 -08:00
Henning Guenther
3b9a84b979 Fixed BootString error 
darcs-hash:20080120002117-a4fee-6b3d8f1bc4dece6960c9319387f5fccca41620b4
 2008-01-19 16:21:17 -08:00
Henning Guenther
59a8526727 Better detection of UTF16 endianess 
darcs-hash:20080119232705-a4fee-ff06e72d08068de9566b37cbc3e31f1e944162ea
 2008-01-19 15:27:05 -08:00
Henning Guenther
529953686a Fixed UTF16 decoding error 
darcs-hash:20080116013924-a4fee-802818436b13cc8d3df5d772074a78cc685ccd10
 2008-01-15 17:39:24 -08:00
Henning Guenther
5a0a697cb8 Implemented UTF32BE and LE 
darcs-hash:20080115233419-a4fee-391b20ca239a6e59a6146f00ae084d0ff94ee908
 2008-01-15 15:34:19 -08:00