# Smart Encoding

SMS messages can be encoded in two ways:

* GSM-7: Supports 160 characters in the first segment/message (or 153 in concatenated messages);
* UCS-2 (Unicode): Required for special characters, but only supports 70 characters in the first segment/message (or 67 in concatenated messages);

When your message contains certain Unicode characters (such as "smart quotes" from word processors), the entire message must be sent as UCS-2, which significantly reduces the character limit. Smart Encoding attempts to replace these characters with GSM-7 compatible alternatives.

### How to Enable

Add `meta.sms.smartEncoding`: `true` to your SMS message options:

```json
POST /workspaces/{workspaceId}/channels/{channelId}/messages
{
  "receiver": {
    "contacts": [{ "identifierValue": "+1234567890" }]
  },
  "body": {
    "type": "text",
    "text": { "text": "“Hello”! Can’t wait for our meeting!" }
  },
  "meta": {
    "sms": {
      "smartEncoding": true
    }
  }
}
```

*In* [*Navigators*](https://docs.bird.com/api/channels-api/api-reference/navigators)*, this feature works exactly the same.*

### How It Works

When smartEncoding is enabled:

1. Transliteration: The system replaces known Unicode characters with GSM-7 equivalents (e.g., `“` → `"` , `…` → `...`)
2. Compatibility Check: After transliteration, the system checks if the result is fully GSM-7 compatible
3. Outcome:
   1. Success: If all characters are now GSM-7-compatible, the transliterated text is used for segment calculation and transmission. The response is `"success"` in `meta.extraInformation.smartEncoded`.
   2. Failed: If non-GSM characters remain (e.g., emoji, CJK characters), the original message is sent as Unicode. The response is `"failed"` in `meta.extraInformation.smartEncoded`.

#### Example

Input message:\
`“Hello” — welcome to our service…` 

After transliteration:\
`"Hello" - welcome to our service...`

This message now fits in GSM-7 encoding (160 char limit) instead of requiring Unicode (70 char limit).

#### Response

When smart encoding is enabled, the message response includes a `smartEncoded` flag in `meta.extraInformation`:

**Message Object:**

```json
{
  "id": "msg-123",
  [...]
  "meta": {
    "extraInformation": {
      "smartEncoded": "success"
    },
    "sms": {
      "smartEncoding": true
    }
  }
}
```

`meta.extraInformation.smartEncoded`  value:

* `success`: Transliteration succeeded; message sent as GSM-7;
* `failed`: Transliteration attempted, but message still contains Unicode; sent as Unicode/UCS-2;

### Character Mapping Reference

<table><thead><tr><th width="120.1328125">Character</th><th width="170.2421875">Unicode</th><th width="120.2890625">Replacement</th><th>Description</th></tr></thead><tbody><tr><td><code>«</code></td><td>U+00AB</td><td><code>"</code></td><td>Left-pointing double angle quotation mark</td></tr><tr><td><code>»</code></td><td>U+00BB</td><td><code>"</code></td><td>Right-pointing double angle quotation mark</td></tr><tr><td><code>"</code></td><td>U+201C</td><td><code>"</code></td><td>Left double quotation mark</td></tr><tr><td><code>"</code></td><td>U+201D</td><td><code>"</code></td><td>Right double quotation mark</td></tr><tr><td><code>ʺ</code></td><td>U+02BA</td><td><code>"</code></td><td>Modifier letter double prime</td></tr><tr><td><code>ˮ</code></td><td>U+02EE</td><td><code>"</code></td><td>Modifier letter double apostrophe</td></tr><tr><td><code>‟</code></td><td>U+201F</td><td><code>"</code></td><td>Double high-reversed-9 quotation mark</td></tr><tr><td><code>❝</code></td><td>U+275D</td><td><code>"</code></td><td>Heavy double turned comma quotation mark ornament</td></tr><tr><td><code>❞</code></td><td>U+275E</td><td><code>"</code></td><td>Heavy double comma quotation mark ornament</td></tr><tr><td><code>〝</code></td><td>U+301D</td><td><code>"</code></td><td>Reversed double prime quotation mark</td></tr><tr><td><code>〞</code></td><td>U+301E</td><td><code>"</code></td><td>Double prime quotation mark</td></tr><tr><td><code>＂</code></td><td>U+FF02</td><td><code>"</code></td><td>Fullwidth quotation mark</td></tr><tr><td><code>„</code></td><td>U+201E</td><td><code>"</code></td><td>Double low-9 quotation mark</td></tr><tr><td><code>'</code></td><td>U+2018</td><td><code>'</code></td><td>Left single quotation mark</td></tr><tr><td><code>'</code></td><td>U+2019</td><td><code>'</code></td><td>Right single quotation mark</td></tr><tr><td><code>ʻ</code></td><td>U+02BB</td><td><code>'</code></td><td>Modifier letter turned comma</td></tr><tr><td><code>ˈ</code></td><td>U+02C8</td><td><code>'</code></td><td>Modifier letter vertical line</td></tr><tr><td><code>ʼ</code></td><td>U+02BC</td><td><code>'</code></td><td>Modifier letter apostrophe</td></tr><tr><td><code>ʽ</code></td><td>U+02BD</td><td><code>'</code></td><td>Modifier letter reversed comma</td></tr><tr><td><code>ʹ</code></td><td>U+02B9</td><td><code>'</code></td><td>Modifier letter prime</td></tr><tr><td><code>‛</code></td><td>U+201B</td><td><code>'</code></td><td>Single high-reversed-9 quotation mark</td></tr><tr><td><code>＇</code></td><td>U+FF07</td><td><code>'</code></td><td>Fullwidth apostrophe</td></tr><tr><td><code>´</code></td><td>U+00B4</td><td><code>'</code></td><td>Acute accent</td></tr><tr><td><code>ˊ</code></td><td>U+02CA</td><td><code>'</code></td><td>Modifier letter acute accent</td></tr><tr><td><code>`</code></td><td>U+0060</td><td><code>'</code></td><td>Grave accent</td></tr><tr><td><code>ˋ</code></td><td>U+02CB</td><td><code>'</code></td><td>Modifier letter grave accent</td></tr><tr><td><code>❛</code></td><td>U+275B</td><td><code>'</code></td><td>Heavy single turned comma quotation mark ornament</td></tr><tr><td><code>❜</code></td><td>U+275C</td><td><code>'</code></td><td>Heavy single comma quotation mark ornament</td></tr><tr><td><code>̓</code></td><td>U+0313</td><td><code>'</code></td><td>Combining comma above</td></tr><tr><td><code>̔</code></td><td>U+0314</td><td><code>'</code></td><td>Combining reversed comma above</td></tr><tr><td><code>︐</code></td><td>U+FE10</td><td><code>'</code></td><td>Presentation form for vertical comma</td></tr><tr><td><code>︑</code></td><td>U+FE11</td><td><code>'</code></td><td>Presentation form for vertical ideographic comma</td></tr><tr><td><code>÷</code></td><td>U+00F7</td><td><code>/</code></td><td>Division sign</td></tr><tr><td><code>¼</code></td><td>U+00BC</td><td><code>1/4</code></td><td>Vulgar fraction one quarter</td></tr><tr><td><code>½</code></td><td>U+00BD</td><td><code>1/2</code></td><td>Vulgar fraction one half</td></tr><tr><td><code>¾</code></td><td>U+00BE</td><td><code>3/4</code></td><td>Vulgar fraction three quarters</td></tr><tr><td><code>⧸</code></td><td>U+29F8</td><td><code>/</code></td><td>Big solidus</td></tr><tr><td><code>̷</code></td><td>U+0337</td><td><code>/</code></td><td>Combining short solidus overlay</td></tr><tr><td><code≯</code></td><td>U+0338</td><td><code>/</code></td><td>Combining long solidus overlay</td></tr><tr><td><code>⁄</code></td><td>U+2044</td><td><code>/</code></td><td>Fraction slash</td></tr><tr><td><code>∕</code></td><td>U+2215</td><td><code>/</code></td><td>Division slash</td></tr><tr><td><code>／</code></td><td>U+FF0F</td><td><code>/</code></td><td>Fullwidth solidus</td></tr><tr><td><code>⧹</code></td><td>U+29F9</td><td><code>\</code></td><td>Big reverse solidus</td></tr><tr><td><code>⧵</code></td><td>U+29F5</td><td><code>\</code></td><td>Reverse solidus operator</td></tr><tr><td><code>⃥</code></td><td>U+20E5</td><td><code>\</code></td><td>Combining reverse solidus overlay</td></tr><tr><td><code>﹨</code></td><td>U+FE68</td><td><code>\</code></td><td>Small reverse solidus</td></tr><tr><td><code>＼</code></td><td>U+FF3C</td><td><code>\</code></td><td>Fullwidth reverse solidus</td></tr><tr><td><code>̲</code></td><td>U+0332</td><td><code>_</code></td><td>Combining low line</td></tr><tr><td><code>＿</code></td><td>U+FF3F</td><td><code>_</code></td><td>Fullwidth low line</td></tr><tr><td><code>‗</code></td><td>U+2017</td><td><code>_</code></td><td>Double low line</td></tr><tr><td><code>⃒</code></td><td>U+20D2</td><td><code>|</code></td><td>Combining long vertical line overlay</td></tr><tr><td><code>⃓</code></td><td>U+20D3</td><td><code>|</code></td><td>Combining short vertical line overlay</td></tr><tr><td><code>∣</code></td><td>U+2223</td><td><code>|</code></td><td>Divides</td></tr><tr><td><code>｜</code></td><td>U+FF5C</td><td><code>|</code></td><td>Fullwidth vertical line</td></tr><tr><td><code>⎸</code></td><td>U+23B8</td><td><code>|</code></td><td>Left vertical box line</td></tr><tr><td><code>⎹</code></td><td>U+23B9</td><td><code>|</code></td><td>Right vertical box line</td></tr><tr><td><code>⏐</code></td><td>U+23D0</td><td><code>|</code></td><td>Vertical line extension</td></tr><tr><td><code>⎜</code></td><td>U+239C</td><td><code>|</code></td><td>Left parenthesis extension</td></tr><tr><td><code>⎟</code></td><td>U+239F</td><td><code>|</code></td><td>Right parenthesis extension</td></tr><tr><td><code>⎼</code></td><td>U+23BC</td><td><code>-</code></td><td>Horizontal scan line-7</td></tr><tr><td><code>⎽</code></td><td>U+23BD</td><td><code>-</code></td><td>Horizontal scan line-9</td></tr><tr><td><code>―</code></td><td>U+2015</td><td><code>-</code></td><td>Horizontal bar</td></tr><tr><td><code>﹣</code></td><td>U+FE63</td><td><code>-</code></td><td>Small hyphen-minus</td></tr><tr><td><code>－</code></td><td>U+FF0D</td><td><code>-</code></td><td>Fullwidth hyphen-minus</td></tr><tr><td><code>‐</code></td><td>U+2010</td><td><code>-</code></td><td>Hyphen</td></tr><tr><td><code>•</code></td><td>U+2022</td><td><code>-</code></td><td>Bullet</td></tr><tr><td><code>⁃</code></td><td>U+2043</td><td><code>-</code></td><td>Hyphen bullet</td></tr><tr><td><code>—</code></td><td>U+2014</td><td><code>-</code></td><td>Em dash</td></tr><tr><td><code>–</code></td><td>U+2013</td><td><code>-</code></td><td>En dash</td></tr><tr><td><code>﹫</code></td><td>U+FE6B</td><td><code>@</code></td><td>Small commercial at</td></tr><tr><td><code>＠</code></td><td>U+FF20</td><td><code>@</code></td><td>Fullwidth commercial at</td></tr><tr><td><code>﹩</code></td><td>U+FE69</td><td><code>$</code></td><td>Small dollar sign</td></tr><tr><td><code>＄</code></td><td>U+FF04</td><td><code>$</code></td><td>Fullwidth dollar sign</td></tr><tr><td><code>ǃ</code></td><td>U+01C3</td><td><code>!</code></td><td>Latin letter retroflex click</td></tr><tr><td><code>︕</code></td><td>U+FE15</td><td><code>!</code></td><td>Presentation form for vertical exclamation mark</td></tr><tr><td><code>﹗</code></td><td>U+FE57</td><td><code>!</code></td><td>Small exclamation mark</td></tr><tr><td><code>！</code></td><td>U+FF01</td><td><code>!</code></td><td>Fullwidth exclamation mark</td></tr><tr><td><code>﹟</code></td><td>U+FE5F</td><td><code>#</code></td><td>Small number sign</td></tr><tr><td><code>＃</code></td><td>U+FF03</td><td><code>#</code></td><td>Fullwidth number sign</td></tr><tr><td><code>﹪</code></td><td>U+FE6A</td><td><code>%</code></td><td>Small percent sign</td></tr><tr><td><code>％</code></td><td>U+FF05</td><td><code>%</code></td><td>Fullwidth percent sign</td></tr><tr><td><code>﹠</code></td><td>U+FE60</td><td><code>&#x26;</code></td><td>Small ampersand</td></tr><tr><td><code>＆</code></td><td>U+FF06</td><td><code>&#x26;</code></td><td>Fullwidth ampersand</td></tr><tr><td><code>‚</code></td><td>U+201A</td><td><code>,</code></td><td>Single low-9 quotation mark</td></tr><tr><td><code>̦</code></td><td>U+0326</td><td><code>,</code></td><td>Combining comma below</td></tr><tr><td><code>﹐</code></td><td>U+FE50</td><td><code>,</code></td><td>Small comma</td></tr><tr><td><code>、</code></td><td>U+3001</td><td><code>,</code></td><td>Ideographic comma</td></tr><tr><td><code>﹑</code></td><td>U+FE51</td><td><code>,</code></td><td>Small ideographic comma</td></tr><tr><td><code>，</code></td><td>U+FF0C</td><td><code>,</code></td><td>Fullwidth comma</td></tr><tr><td><code>､</code></td><td>U+FF64</td><td><code>,</code></td><td>Halfwidth ideographic comma</td></tr><tr><td><code>❨</code></td><td>U+2768</td><td><code>(</code></td><td>Medium left parenthesis ornament</td></tr><tr><td><code>❪</code></td><td>U+276A</td><td><code>(</code></td><td>Medium flattened left parenthesis ornament</td></tr><tr><td><code>﹙</code></td><td>U+FE59</td><td><code>(</code></td><td>Small left parenthesis</td></tr><tr><td><code>（</code></td><td>U+FF08</td><td><code>(</code></td><td>Fullwidth left parenthesis</td></tr><tr><td><code>⟮</code></td><td>U+27EE</td><td><code>(</code></td><td>Mathematical left flattened parenthesis</td></tr><tr><td><code>⦅</code></td><td>U+2985</td><td><code>(</code></td><td>Left white parenthesis</td></tr><tr><td><code>❩</code></td><td>U+2769</td><td><code>)</code></td><td>Medium right parenthesis ornament</td></tr><tr><td><code>❫</code></td><td>U+276B</td><td><code>)</code></td><td>Medium flattened right parenthesis ornament</td></tr><tr><td><code>﹚</code></td><td>U+FE5A</td><td><code>)</code></td><td>Small right parenthesis</td></tr><tr><td><code>）</code></td><td>U+FF09</td><td><code>)</code></td><td>Fullwidth right parenthesis</td></tr><tr><td><code>⟯</code></td><td>U+27EF</td><td><code>)</code></td><td>Mathematical right flattened parenthesis</td></tr><tr><td><code>⦆</code></td><td>U+2986</td><td><code>)</code></td><td>Right white parenthesis</td></tr><tr><td><code>⁎</code></td><td>U+204E</td><td><code>*</code></td><td>Low asterisk</td></tr><tr><td><code>∗</code></td><td>U+2217</td><td><code>*</code></td><td>Asterisk operator</td></tr><tr><td><code>⊛</code></td><td>U+229B</td><td><code>*</code></td><td>Circled asterisk operator</td></tr><tr><td><code>✢</code></td><td>U+2722</td><td><code>*</code></td><td>Four teardrop-spoked asterisk</td></tr><tr><td><code>✣</code></td><td>U+2723</td><td><code>*</code></td><td>Four balloon-spoked asterisk</td></tr><tr><td><code>✤</code></td><td>U+2724</td><td><code>*</code></td><td>Heavy four balloon-spoked asterisk</td></tr><tr><td><code>✥</code></td><td>U+2725</td><td><code>*</code></td><td>Four club-spoked asterisk</td></tr><tr><td><code>✱</code></td><td>U+2731</td><td><code>*</code></td><td>Heavy asterisk</td></tr><tr><td><code>✲</code></td><td>U+2732</td><td><code>*</code></td><td>Open centre asterisk</td></tr><tr><td><code>✳</code></td><td>U+2733</td><td><code>*</code></td><td>Eight spoked asterisk</td></tr><tr><td><code>✺</code></td><td>U+273A</td><td><code>*</code></td><td>Sixteen pointed asterisk</td></tr><tr><td><code>✻</code></td><td>U+273B</td><td><code>*</code></td><td>Teardrop-spoked asterisk</td></tr><tr><td><code>✼</code></td><td>U+273C</td><td><code>*</code></td><td>Open centre teardrop-spoked asterisk</td></tr><tr><td><code>✽</code></td><td>U+273D</td><td><code>*</code></td><td>Heavy teardrop-spoked asterisk</td></tr><tr><td><code>❃</code></td><td>U+2743</td><td><code>*</code></td><td>Heavy teardrop-spoked pinwheel asterisk</td></tr><tr><td><code>❉</code></td><td>U+2749</td><td><code>*</code></td><td>Balloon-spoked asterisk</td></tr><tr><td><code>❊</code></td><td>U+274A</td><td><code>*</code></td><td>Eight teardrop-spoked propeller asterisk</td></tr><tr><td><code>❋</code></td><td>U+274B</td><td><code>*</code></td><td>Heavy eight teardrop-spoked propeller asterisk</td></tr><tr><td><code>⧆</code></td><td>U+29C6</td><td><code>*</code></td><td>Squared asterisk</td></tr><tr><td><code>﹡</code></td><td>U+FE61</td><td><code>*</code></td><td>Small asterisk</td></tr><tr><td><code>＊</code></td><td>U+FF0A</td><td><code>*</code></td><td>Fullwidth asterisk</td></tr><tr><td><code>˖</code></td><td>U+02D6</td><td><code>+</code></td><td>Modifier letter plus sign</td></tr><tr><td><code>﹢</code></td><td>U+FE62</td><td><code>+</code></td><td>Small plus sign</td></tr><tr><td><code>＋</code></td><td>U+FF0B</td><td><code>+</code></td><td>Fullwidth plus sign</td></tr><tr><td><code>。</code></td><td>U+3002</td><td><code>.</code></td><td>Ideographic full stop</td></tr><tr><td><code>﹒</code></td><td>U+FE52</td><td><code>.</code></td><td>Small full stop</td></tr><tr><td><code>．</code></td><td>U+FF0E</td><td><code>.</code></td><td>Fullwidth full stop</td></tr><tr><td><code>｡</code></td><td>U+FF61</td><td><code>.</code></td><td>Halfwidth ideographic full stop</td></tr><tr><td><code>０</code>-<code>９</code></td><td>U+FF10-U+FF19</td><td><code>0</code>-<code>9</code></td><td>Fullwidth digits</td></tr><tr><td><code>ː</code></td><td>U+02D0</td><td><code>:</code></td><td>Modifier letter triangular colon</td></tr><tr><td><code>˸</code></td><td>U+02F8</td><td><code>:</code></td><td>Modifier letter raised colon</td></tr><tr><td><code>⦂</code></td><td>U+2982</td><td><code>:</code></td><td>Z notation type colon</td></tr><tr><td><code>꞉</code></td><td>U+A789</td><td><code>:</code></td><td>Modifier letter colon</td></tr><tr><td><code>︓</code></td><td>U+FE13</td><td><code>:</code></td><td>Presentation form for vertical colon</td></tr><tr><td><code>：</code></td><td>U+FF1A</td><td><code>:</code></td><td>Fullwidth colon</td></tr><tr><td><code>⁏</code></td><td>U+204F</td><td><code>;</code></td><td>Reversed semicolon</td></tr><tr><td><code>︔</code></td><td>U+FE14</td><td><code>;</code></td><td>Presentation form for vertical semicolon</td></tr><tr><td><code>﹔</code></td><td>U+FE54</td><td><code>;</code></td><td>Small semicolon</td></tr><tr><td><code>；</code></td><td>U+FF1B</td><td><code>;</code></td><td>Fullwidth semicolon</td></tr><tr><td><code>﹤</code></td><td>U+FE64</td><td><code>&#x3C;</code></td><td>Small less-than sign</td></tr><tr><td><code>＜</code></td><td>U+FF1C</td><td><code>&#x3C;</code></td><td>Fullwidth less-than sign</td></tr><tr><td><code>‹</code></td><td>U+2039</td><td><code>&#x3C;</code></td><td>Single left-pointing angle quotation mark</td></tr><tr><td><code>͇</code></td><td>U+0347</td><td><code>=</code></td><td>Combining equals sign below</td></tr><tr><td><code>꞊</code></td><td>U+A78A</td><td><code>=</code></td><td>Modifier letter short equals sign</td></tr><tr><td><code>﹦</code></td><td>U+FE66</td><td><code>=</code></td><td>Small equals sign</td></tr><tr><td><code>＝</code></td><td>U+FF1D</td><td><code>=</code></td><td>Fullwidth equals sign</td></tr><tr><td><code>﹥</code></td><td>U+FE65</td><td><code>></code></td><td>Small greater-than sign</td></tr><tr><td><code>＞</code></td><td>U+FF1E</td><td><code>></code></td><td>Fullwidth greater-than sign</td></tr><tr><td><code>›</code></td><td>U+203A</td><td><code>></code></td><td>Single right-pointing angle quotation mark</td></tr><tr><td><code>︖</code></td><td>U+FE16</td><td><code>?</code></td><td>Presentation form for vertical question mark</td></tr><tr><td><code>﹖</code></td><td>U+FE56</td><td><code>?</code></td><td>Small question mark</td></tr><tr><td><code>？</code></td><td>U+FF1F</td><td><code>?</code></td><td>Fullwidth question mark</td></tr><tr><td><code>Ａ</code>-<code>Ｚ</code></td><td>U+FF21-+FF3A</td><td><code>A</code>-<code>Z</code></td><td>Fullwidth Latin capital letters</td></tr><tr><td><code>ᴀ</code>-<code>ᴢ</code></td><td>U+1D00-U+1D22</td><td><code>A</code>-<code>Z</code></td><td>Latin letters small capital</td></tr><tr><td><code>ˆ</code></td><td>U+02C6</td><td><code>^</code></td><td>Modifier letter circumflex accent</td></tr><tr><td><code>̂</code></td><td>U+0302</td><td><code>^</code></td><td>Combining circumflex accent</td></tr><tr><td><code>＾</code></td><td>U+FF3E</td><td><code>^</code></td><td>Fullwidth circumflex accent</td></tr><tr><td><code>᷍</code></td><td>U+1DCD</td><td><code>^</code></td><td>Combining double circumflex above</td></tr><tr><td><code>❴</code></td><td>U+2774</td><td><code>{</code></td><td>Medium left curly bracket ornament</td></tr><tr><td><code>﹛</code></td><td>U+FE5B</td><td><code>{</code></td><td>Small left curly bracket</td></tr><tr><td><code>｛</code></td><td>U+FF5B</td><td><code>{</code></td><td>Fullwidth left curly bracket</td></tr><tr><td><code>❵</code></td><td>U+2775</td><td><code>}</code></td><td>Medium right curly bracket ornament</td></tr><tr><td><code>﹜</code></td><td>U+FE5C</td><td><code>}</code></td><td>Small right curly bracket</td></tr><tr><td><code>｝</code></td><td>U+FF5D</td><td><code>}</code></td><td>Fullwidth right curly bracket</td></tr><tr><td><code>［</code></td><td>U+FF3B</td><td><code>[</code></td><td>Fullwidth left square bracket</td></tr><tr><td><code>］</code></td><td>U+FF3D</td><td><code>]</code></td><td>Fullwidth right square bracket</td></tr><tr><td><code>˜</code></td><td>U+02DC</td><td><code>~</code></td><td>Small tilde</td></tr><tr><td><code>˷</code></td><td>U+02F7</td><td><code>~</code></td><td>Modifier letter low tilde</td></tr><tr><td><code>̃</code></td><td>U+0303</td><td><code>~</code></td><td>Combining tilde</td></tr><tr><td><code>̰</code></td><td>U+0330</td><td><code>~</code></td><td>Combining tilde below</td></tr><tr><td><code>̴</code></td><td>U+0334</td><td><code>~</code></td><td>Combining tilde overlay</td></tr><tr><td><code>∼</code></td><td>U+223C</td><td><code>~</code></td><td>Tilde operator</td></tr><tr><td><code>～</code></td><td>U+FF5E</td><td><code>~</code></td><td>Fullwidth tilde</td></tr><tr><td><code>‼</code></td><td>U+203C</td><td><code>!!</code></td><td>Double exclamation mark</td></tr><tr><td><code>…</code></td><td>U+2026</td><td><code>...</code></td><td>Horizontal ellipsis</td></tr><tr><td></td><td>U+00A0</td><td></td><td>No-break space</td></tr><tr><td></td><td>U+2000</td><td></td><td>En quad</td></tr><tr><td></td><td>U+2001</td><td></td><td>Em quad</td></tr><tr><td></td><td>U+2002</td><td></td><td>En space</td></tr><tr><td></td><td>U+2003</td><td></td><td>Em space</td></tr><tr><td></td><td>U+2004</td><td></td><td>Three-per-em space</td></tr><tr><td></td><td>U+2005</td><td></td><td>Four-per-em space</td></tr><tr><td></td><td>U+2006</td><td></td><td>Six-per-em space</td></tr><tr><td></td><td>U+2007</td><td></td><td>Figure space</td></tr><tr><td></td><td>U+2008</td><td></td><td>Punctuation space</td></tr><tr><td></td><td>U+2009</td><td></td><td>Thin space</td></tr><tr><td></td><td>U+200A</td><td></td><td>Hair space</td></tr><tr><td></td><td>U+202F</td><td></td><td>Narrow no-break space</td></tr><tr><td></td><td>U+205F</td><td></td><td>Medium mathematical space</td></tr><tr><td></td><td>U+3000</td><td></td><td>Ideographic space</td></tr><tr><td></td><td>U+200B</td><td><em>(removed)</em></td><td>Zero width space</td></tr><tr><td></td><td>U+FEFF</td><td><em>(removed)</em></td><td>Zero width no-break space (BOM)</td></tr><tr><td></td><td>U+2060</td><td><em>(removed)</em></td><td>Word joiner</td></tr><tr><td></td><td>U+2028</td><td><em>(removed)</em></td><td>Line separator</td></tr><tr><td></td><td>U+2029</td><td><em>(removed)</em></td><td>Paragraph separator</td></tr></tbody></table>

### Limitations

Smart encoding cannot help with:

* Emoji: 😀, ❤️, etc. require Unicode;
* CJK characters: Chinese, Japanese, and Korean scripts;
* Arabic, Hebrew, Thai: Scripts not in GSM-7;
* Accented characters not in GSM-7: Characters like `ő`, `ű` (only basic accents like `é`, `ü` are in GSM-7);