|
|
jira.mariadb.org_one_issue.rss.xml - sfeed_tests - sfeed tests and RSS and Atom files |
|
|
 |
git clone git://git.codemadness.org/sfeed_tests (git://git.codemadness.org) |
|
|
 |
Log |
|
|
 |
Files |
|
|
 |
Refs |
|
|
 |
README |
|
|
 |
LICENSE |
|
|
|
--- |
|
|
|
jira.mariadb.org_one_issue.rss.xml (44044B) |
|
|
|
--- |
|
|
|
1 <?xml version="1.0" encoding="UTF-8"?><!-- |
|
|
|
2 RSS generated by JIRA (8.13.13#813013-sha1:3ab5fbe7b6c572b1ee4ccec98a9f447334884e00) at Sun Nov 21 11:54:36 UTC 2021 |
|
|
|
3 |
|
|
|
4 It is possible to restrict the fields that are returned in this document by specifying the 'field' parameter in your request. |
|
|
|
5 For example, to request only the issue key and summary append 'field=key&field=summary' to the URL of your request. |
|
|
|
6 --><rss version="0.92"> |
|
|
|
7 <channel> |
|
|
|
8 <title>Jira</title> |
|
|
|
9 <link>https://jira.mariadb.org</link> |
|
|
|
10 <description>This file is an XML representation of an issue</description> |
|
|
|
11 <language>en-us</language> <build-info> |
|
|
|
12 <version>8.13.13</version> |
|
|
|
13 <build-number>813013</build-number> |
|
|
|
14 <build-date>28-10-2021</build-date> |
|
|
|
15 </build-info> |
|
|
|
16 |
|
|
|
17 |
|
|
|
18 <item> |
|
|
|
19 <title>[MDEV-8334] Rename utf8 to utf8mb3 </title> |
|
|
|
20 <link>https://jira.mariadb.org/browse/MDEV-8334</link> |
|
|
|
21 <project id="10000" key="MDEV">MariaDB Server</project> |
|
|
|
22 <description><p>Currently MariaDB's has two utf8 character sets:</p> |
|
|
|
23 |
|
|
|
24 <ul class="alternate" type="square"> |
|
|
|
25 <li>utf8 that can store 1 to 3 byte characters and implements Unicode BMP range U+0000..U+FFFF<br/> |
|
|
|
26 This character set is also available under name "utf8mb3"</li> |
|
|
|
27 </ul> |
|
|
|
28 |
|
|
|
29 |
|
|
|
30 <ul class="alternate" type="square"> |
|
|
|
31 <li>utf8mb4 that can store 1 to 4 byte characters and implements the full Unicode standard range U+0000..U+10FFFF.</li> |
|
|
|
32 </ul> |
|
|
|
33 |
|
|
|
34 |
|
|
|
35 <p>In long terms we want the name utf8 mean the full featured UTF-8.<br/> |
|
|
|
36 We'll do a few preparatory steps:</p> |
|
|
|
37 |
|
|
|
38 <p>1. Change the main name of the 3-byte character set from "utf8" to "utf8m3" and make "utf8" alias for "utf8mb3". This will change all SHOW and INFORMATION_SCHEMA output to display utf8mb3 instread of utf8, as well as change mysqldump to dump utf8mb3 instead of just utf8.</p> |
|
|
|
39 |
|
|
|
40 <p>2. Add a new server option, say --utf8-is-utf8mb3, which will be true by default, but the DBA will be able to change it to false and thus make "utf8" mean "utf8mb4".</p> |
|
|
|
41 |
|
|
|
42 <p>3. A few releases later we'll change --utf8-is-utf8mb3 to be "false" by default.</p> |
|
|
|
43 |
|
|
|
44 <p>Or</p> |
|
|
|
45 |
|
|
|
46 <p>2. do not add any new server options and<br/> |
|
|
|
47 3. add a new old_mode value for reverting utf8 to utf8mb3 when the default will mean utf8mb4<br/> |
|
|
|
48 (optionally)4. make utf8 to mean utf8mb4 already in 10.6 and make the default value of old_mode to revert this in 10.6</p> |
|
|
|
49 |
|
|
|
50 <p>Or </p> |
|
|
|
51 |
|
|
|
52 <p>Do not add any new server options and implement charset aliases via the SQL standard statement:</p> |
|
|
|
53 <p/> |
|
|
|
54 <div id="syntaxplugin" class="syntaxplugin" style="border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;"> |
|
|
|
55 <table cellspacing="0" cellpadding="0" border="0" width="100%" style="font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;"> |
|
|
|
56 <tbody > |
|
|
|
57 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
58 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
59 <pre style="font-size: 1em; margin: 0 10px; margin-top: 10px; width: auto; padding: 0;"><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CREATE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CHARACTER</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">SET</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> &lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">name</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&gt; [ </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">AS</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> ] &lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> source&gt; [ &lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">collate</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> clause&gt; ]</span></pre> |
|
|
|
60 </td> |
|
|
|
61 </tr> |
|
|
|
62 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
63 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
64 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> source&gt; ::= GET &lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> specification&gt;</span></pre> |
|
|
|
65 </td> |
|
|
|
66 </tr> |
|
|
|
67 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
68 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
69 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&lt;</span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> specification&gt; ::=</span></pre> |
|
|
|
70 </td> |
|
|
|
71 </tr> |
|
|
|
72 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
73 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
74 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> &lt;standard </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">name</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&gt;</span></pre> |
|
|
|
75 </td> |
|
|
|
76 </tr> |
|
|
|
77 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
78 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
79 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> | &lt;implementation-defined </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">name</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&gt;</span></pre> |
|
|
|
80 </td> |
|
|
|
81 </tr> |
|
|
|
82 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
83 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
84 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> | &lt;</span><span style="color: #2B91AF; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">user</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">-defined </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">character</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">set</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">name</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">&gt;</span></pre> |
|
|
|
85 </td> |
|
|
|
86 </tr> |
|
|
|
87 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
88 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
89 <pre style="font-size: 1em; margin: 0 10px; margin-bottom: 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> |
|
|
|
90 </span></pre> |
|
|
|
91 </td> |
|
|
|
92 </tr> |
|
|
|
93 </tbody> |
|
|
|
94 </table> |
|
|
|
95 </div> |
|
|
|
96 <p/> |
|
|
|
97 |
|
|
|
98 <h2><a name="Alternativesolution"></a>Alternative solution</h2> |
|
|
|
99 |
|
|
|
100 <p>Originally, there were two reasons to have two utf8 implementations:</p> |
|
|
|
101 <ul class="alternate" type="square"> |
|
|
|
102 <li>The CHAR column needs less space in case of utf8mb3. InnoDB can store CHAR in a packed format, so space needed is the same for utf8mb3 and utf8mb4 on the same data. Other engines could probably do the same trick to safe space: store CHAR in a packed format with trailing spaces removed.</li> |
|
|
|
103 <li>Before 10.5, filesort was faster for utf8mb3 than for utf8mb4, because utf8mb3 needs to reserve less bytes for one weight. Now with Varun's improvements (e.g. <a href="https://jira.mariadb.org/browse/MDEV-21580" title="Allow packed sort keys in sort buffer" class="issue-link" data-issue-key="MDEV-21580"><del>MDEV-21580</del></a>) in filesort (sort buffer now can store the original string instead if its weight array), filesort should be the same fast for utf8mb3 and utf8mb4 on equal data sets.</li> |
|
|
|
104 </ul> |
|
|
|
105 |
|
|
|
106 |
|
|
|
107 <p>So we could have just one "utf8", with the following aliases:</p> |
|
|
|
108 <ul class="alternate" type="square"> |
|
|
|
109 <li>utf8mb4 is just a simple alias for the "new utf8"</li> |
|
|
|
110 <li>utf8mb3 is also an alias for the "new utf8", but with an automatic constraint added</li> |
|
|
|
111 </ul> |
|
|
|
112 |
|
|
|
113 |
|
|
|
114 <p>After the upgrade, <tt>SHOW</tt> for old tables with the 3-byte utf8 could be displayed about like this:</p> |
|
|
|
115 <p/> |
|
|
|
116 <div id="syntaxplugin" class="syntaxplugin" style="border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;"> |
|
|
|
117 <table cellspacing="0" cellpadding="0" border="0" width="100%" style="font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;"> |
|
|
|
118 <tbody > |
|
|
|
119 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
120 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
121 <pre style="font-size: 1em; margin: 0 10px; margin-top: 10px; width: auto; padding: 0;"><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CREATE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">TABLE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> t1</span></pre> |
|
|
|
122 </td> |
|
|
|
123 </tr> |
|
|
|
124 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
125 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
126 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(</span></pre> |
|
|
|
127 </td> |
|
|
|
128 </tr> |
|
|
|
129 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
130 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
131 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> a </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">VARCHAR</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(10) </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CHARACTER</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">SET</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> utf8 </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CHECK</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(is_bmp_only(a))</span></pre> |
|
|
|
132 </td> |
|
|
|
133 </tr> |
|
|
|
134 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
135 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
136 <pre style="font-size: 1em; margin: 0 10px; margin-bottom: 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">); |
|
|
|
137 </span></pre> |
|
|
|
138 </td> |
|
|
|
139 </tr> |
|
|
|
140 </tbody> |
|
|
|
141 </table> |
|
|
|
142 </div> |
|
|
|
143 <p/> |
|
|
|
144 <p>where <tt>is_bmp_only()</tt> is a new built-in function to test if a string contains only Basic Multilingual Plane characters and returning:</p> |
|
|
|
145 <ul class="alternate" type="square"> |
|
|
|
146 <li>TRUE if a string contains only BMP characters <tt>U+0000..U+FFFF</tt>, fitting into 3-byte utf8 sequences</li> |
|
|
|
147 <li>FALSE if the string has characters outside of BMP, i.e. <tt>U+10000..U+10FFFF</tt>, and therefore require 4 bytes in utf8 encoding.</li> |
|
|
|
148 </ul> |
|
|
|
149 |
|
|
|
150 |
|
|
|
151 <p>The exact API for the constrain function may be different, e.g. it could test for an arbitrary Unicode character range (not only BMP vs non-BMP). This could be useful for other purposes as well.</p> |
|
|
|
152 |
|
|
|
153 <p>Open questions:</p> |
|
|
|
154 <ul class="alternate" type="square"> |
|
|
|
155 <li>It's not clear how to handle the database and the table level clause <tt>CHARACTER SET utf8mb3</tt>: |
|
|
|
156 <p/> |
|
|
|
157 <div id="syntaxplugin" class="syntaxplugin" style="border: 1px dashed #bbb; border-radius: 5px !important; overflow: auto; max-height: 30em;"> |
|
|
|
158 <table cellspacing="0" cellpadding="0" border="0" width="100%" style="font-size: 1em; line-height: 1.4em !important; font-weight: normal; font-style: normal; color: black;"> |
|
|
|
159 <tbody > |
|
|
|
160 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
161 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
162 <pre style="font-size: 1em; margin: 0 10px; margin-top: 10px; width: auto; padding: 0;"><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CREATE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">TABLE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> t1</span></pre> |
|
|
|
163 </td> |
|
|
|
164 </tr> |
|
|
|
165 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
166 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
167 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(</span></pre> |
|
|
|
168 </td> |
|
|
|
169 </tr> |
|
|
|
170 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
171 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
172 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> a </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">VARCHAR</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(10)</span></pre> |
|
|
|
173 </td> |
|
|
|
174 </tr> |
|
|
|
175 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
176 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
177 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">) </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CHARACTER</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">SET</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> utf8mb3;</span></pre> |
|
|
|
178 </td> |
|
|
|
179 </tr> |
|
|
|
180 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
181 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
182 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;">&nbsp;</pre> |
|
|
|
183 </td> |
|
|
|
184 </tr> |
|
|
|
185 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
186 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
187 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CREATE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">TABLE</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> t2</span></pre> |
|
|
|
188 </td> |
|
|
|
189 </tr> |
|
|
|
190 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
191 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
192 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(</span></pre> |
|
|
|
193 </td> |
|
|
|
194 </tr> |
|
|
|
195 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
196 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
197 <pre style="font-size: 1em; margin: 0 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> a </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">VARCHAR</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">(10)</span></pre> |
|
|
|
198 </td> |
|
|
|
199 </tr> |
|
|
|
200 <tr id="syntaxplugin_code_and_gutter"> |
|
|
|
201 <td style=" line-height: 1.4em !important; padding: 0em; vertical-align: top;"> |
|
|
|
202 <pre style="font-size: 1em; margin: 0 10px; margin-bottom: 10px; width: auto; padding: 0;"><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">) </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">CHARACTER</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> </span><span style="color: #006699; font-weight: bold; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;">SET</span><span style="color: black; font-family: 'Consolas', 'Bitstream Vera Sans Mono', 'Courier New', Courier, monospace !important;"> utf8mb4; |
|
|
|
203 </span></pre> |
|
|
|
204 </td> |
|
|
|
205 </tr> |
|
|
|
206 </tbody> |
|
|
|
207 </table> |
|
|
|
208 </div> |
|
|
|
209 <p/> |
|
|
|
210 <p>The table level CHARACTER SET for "t1" could probably automatically add the constraint into all columns that would have implicitly created as utf8mb3.</p></li> |
|
|
|
211 <li>TODO: add upgrade details</li> |
|
|
|
212 <li>TODO: add replication details</li> |
|
|
|
213 </ul> |
|
|
|
214 </description> |
|
|
|
215 <key id="51838">MDEV-8334</key> |
|
|
|
216 <summary>Rename utf8 to utf8mb3 </summary> |
|
|
|
217 <type iconUrl="https://jira.mariadb.org/secure/viewavatar?size=xsmall&avatarId=14118&avatarType=issuetype" id="3">Task</type> |
|
|
|
218 <priority iconUrl="https://jira.mariadb.org/images/icons/priorities/blocker.svg" id="1">Blocker</priority> |
|
|
|
219 <status description="" iconUrl="https://jira.mariadb.org/images/icons/statuses/closed.png" id="6">Closed</status> |
|
|
|
220 <statusCategory colorName="green" id="3" key="done"/> |
|
|
|
221 <resolution id="1">Fixed</resolution> |
|
|
|
222 <assignee username="sanja">Oleksandr Byelkin</assignee> |
|
|
|
223 <reporter username="bar">Alexander Barkov</reporter> |
|
|
|
224 <labels> |
|
|
|
225 </labels> |
|
|
|
226 <created>Thu, 18 Jun 2015 12:04:39 +0000</created> |
|
|
|
227 <updated>Thu, 21 Oct 2021 12:40:34 +0000</updated> |
|
|
|
228 <resolved>Wed, 19 May 2021 05:41:13 +0000</resolved> |
|
|
|
229 <fixVersion>10.6.1</fixVersion> |
|
|
|
230 <component>Character Sets</component> |
|
|
|
231 <due/> |
|
|
|
232 <votes>8</votes> |
|
|
|
233 <watches>20</watches> |
|
|
|
234 <comments> |
|
|
|
235 <comment author="bar" created="Mon, 26 Nov 2018 11:11:43 +0000" id="119799"><p><a href="https://jira.mariadb.org/secure/ViewProfile.jspa?name=ralf.gebhardt%40mariadb.com" class="user-hover" rel="ralf.gebhardt@mariadb.com">Ralf Gebhardt</a>, this is a good idea. We can keep this MDEV as a "super task", and have individual three tasks for every step.</p></comment> |
|
|
|
236 <comment author="poseidoncore" created="Fri, 17 May 2019 11:11:05 +0000" id="127950"><p>This might both conflict with and agree with the long-term usage envisaged for MySQL ... :</p> |
|
|
|
237 |
|
|
|
238 <p><a href="https://dev.mysql.com/doc/refman/8.0/en/charset-unicode-sets.html" class="external-link" target="_blank" rel="nofollow noopener">https://dev.mysql.com/doc/refman/8.0/en/charset-unicode-sets.html</a></p> |
|
|
|
239 |
|
|
|
240 <p>-------------------------------------------------------------------------------<br/> |
|
|
|
241 Note<br/> |
|
|
|
242 The utf8mb3 character set is deprecated and will be removed in a future MySQL release. Please use utf8mb4 instead. Although utf8 is currently an alias for utf8mb3, at some point utf8 will become a reference to utf8mb4. To avoid ambiguity about the meaning of utf8, consider specifying utf8mb4 explicitly for character set references instead of utf8.<br/> |
|
|
|
243 -------------------------------------------------------------------------------</p></comment> |
|
|
|
244 <comment author="nunop" created="Tue, 2 Jul 2019 20:48:24 +0000" id="130359"><p>Hello,</p> |
|
|
|
245 |
|
|
|
246 <p>Is this going to fix/improve the fact that, many times, when inserting 150 characters on a VARCHAR(200) returns a truncation error?</p> |
|
|
|
247 |
|
|
|
248 <p>This happens when using utf8 or utf8mb4.</p> |
|
|
|
249 |
|
|
|
250 <p>Thank you.</p></comment> |
|
|
|
251 <comment author="bar" created="Wed, 30 Oct 2019 13:52:36 +0000" id="136646"><p><a href="https://jira.mariadb.org/secure/ViewProfile.jspa?name=julien.fritsch" class="user-hover" rel="julien.fritsch">Julien Fritsch</a>, yes, I want to finish it before beta.</p></comment> |
|
|
|
252 <comment author="JIRAUSER40845" created="Fri, 31 Jan 2020 22:08:00 +0000" id="143461"><p>I fear is that upgrades will fail. And downgrades will be problematic. Think about these issues when changing the meaning of utf8, even if it is to the equivalent utf8mb3. Also be aware that doing something different than Oracle will lead to a lot of grief when people try to move from (or to) MySQL.</p></comment> |
|
|
|
253 <comment author="dwt" created="Tue, 25 Aug 2020 08:22:16 +0000" id="164047"><p>I'm getting lots of change mail from this bug, but I don't see any changes. Is there a script running amok here perhaps?</p></comment> |
|
|
|
254 <comment author="julien.fritsch" created="Tue, 25 Aug 2020 09:17:37 +0000" id="164062"><p><a href="https://jira.mariadb.org/secure/ViewProfile.jspa?name=dwt" class="user-hover" rel="dwt">Martin Häcker</a> you are getting all those emails from this task, because <a href="https://jira.mariadb.org/secure/ViewProfile.jspa?name=bar" class="user-hover" rel="bar">Alexander Barkov</a> is working on it and is updating the description. If you don't want to get those, you can stop to watch it.</p></comment> |
|
|
|
255 <comment author="sanja" created="Tue, 17 Nov 2020 11:39:42 +0000" id="172253"><p>The plan is:</p> |
|
|
|
256 <ol> |
|
|
|
257 <li>rename utf8 -&gt; utf8mb3</li> |
|
|
|
258 <li>make utf8 alias of utf8mb4</li> |
|
|
|
259 <li>make old_mode=UTF8_IS_UTF8MB3 where utf8 is an alias of utf8mb3</li> |
|
|
|
260 <li>make UTF8_IS_UTF8MB3 default setting</li> |
|
|
|
261 </ol> |
|
|
|
262 </comment> |
|
|
|
263 <comment author="nunop" created="Tue, 17 Nov 2020 13:41:27 +0000" id="172280"><p>Guys,<br/> |
|
|
|
264 This looks great.</p> |
|
|
|
265 |
|
|
|
266 <p>I just want to ask,<br/> |
|
|
|
267 if we activate UTF8_IS_UTF8MB3, the existing tables will be unaffected, right? Just the definition will start saying "utf8mb3" rather than "utf8", is that it?</p></comment> |
|
|
|
268 <comment author="serg" created="Tue, 17 Nov 2020 17:23:53 +0000" id="172333"><p>Correct.<br/> |
|
|
|
269 With a minor detail that you don't need to activate UTF8_IS_UTF8MB3, it'll be active by default in 10.6</p></comment> |
|
|
|
270 <comment author="rucha174" created="Sat, 17 Apr 2021 09:33:32 +0000" id="186439"><p>PR for mariadb-connector-c: <a href="https://github.com/mariadb-corporation/mariadb-connector-c/pull/169" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/mariadb-corporation/mariadb-connector-c/pull/169</a><br/> |
|
|
|
271 <a href="https://jira.mariadb.org/secure/ViewProfile.jspa?name=serg" class="user-hover" rel="serg">Sergei Golubchik</a> patch for server after latest review:<br/> |
|
|
|
272 <a href="https://github.com/MariaDB/server/commit/3072ba1b7cafc97a4df0909885d8c7cb30121e35" class="external-link" target="_blank" rel="nofollow noopener">https://github.com/MariaDB/server/commit/3072ba1b7cafc97a4df0909885d8c7cb30121e35</a></p></comment> |
|
|
|
273 <comment author="marko" created="Wed, 21 Apr 2021 09:04:49 +0000" id="186816"><p>The Connector/C part has apparently been applied. I <a href="https://github.com/MariaDB/server/commit/4930f9c94bb610f4d76b73a8b6b351d9fa9c5d68" class="external-link" target="_blank" rel="nofollow noopener">merged it to 10.6</a> and adjusted <tt>tests/mysql_client_test.c</tt> accordingly.</p></comment> |
|
|
|
274 <comment author="sanja" created="Thu, 22 Apr 2021 09:43:05 +0000" id="186963"><p>OK to push</p></comment> |
|
|
|
275 <comment author="poseidoncore" created="Thu, 29 Apr 2021 10:05:00 +0000" id="187966"><p>See new documentation on <a href="https://mariadb.com/kb/en/old-mode/" class="external-link" target="_blank" rel="nofollow noopener">OLD_MODE</a> for more info:</p> |
|
|
|
276 |
|
|
|
277 <p><a href="https://mariadb.com/kb/en/old-mode/" class="external-link" target="_blank" rel="nofollow noopener">https://mariadb.com/kb/en/old-mode/</a></p></comment> |
|
|
|
278 <comment author="serg" created="Tue, 11 May 2021 06:58:26 +0000" id="189003"><p>commit 3072ba1b7ca is ok to push, thanks!</p></comment> |
|
|
|
279 <comment author="dwt" created="Wed, 19 May 2021 06:00:57 +0000" id="189754"><p>As the guy who triggered all of this with a bug report many years ago - after all this time - I just want to say thank you for the work you guys put in to make this happen. Stopping the confusion of utf8 (utf8mb3) with utf8mb4 in MariaDB is a huge thing and still something I have to fight all the time because people just miss it.</p> |
|
|
|
280 |
|
|
|
281 <p>This will help a lot!</p> |
|
|
|
282 |
|
|
|
283 <p>Thanks!</p></comment> |
|
|
|
284 <comment author="roel" created="Tue, 15 Jun 2021 09:07:23 +0000" id="191923"><p>See <a href="https://jira.mariadb.org/browse/MDEV-8334" title="Rename utf8 to utf8mb3 " class="issue-link" data-issue-key="MDEV-8334"><del>MDEV-8334</del></a></p></comment> |
|
|
|
285 </comments> |
|
|
|
286 <issuelinks> |
|
|
|
287 <issuelinktype id="10000"> |
|
|
|
288 <name>Blocks</name> |
|
|
|
289 <outwardlinks description="blocks"> |
|
|
|
290 <issuelink> |
|
|
|
291 <issuekey id="49011">MDEV-7128</issuekey> |
|
|
|
292 </issuelink> |
|
|
|
293 </outwardlinks> |
|
|
|
294 <inwardlinks description="is blocked by"> |
|
|
|
295 <issuelink> |
|
|
|
296 <issuekey id="77106">MDEV-19897</issuekey> |
|
|
|
297 </issuelink> |
|
|
|
298 <issuelink> |
|
|
|
299 <issuekey id="82716">MDEV-21581</issuekey> |
|
|
|
300 </issuelink> |
|
|
|
301 </inwardlinks> |
|
|
|
302 </issuelinktype> |
|
|
|
303 <issuelinktype id="10500"> |
|
|
|
304 <name>Problem/Incident</name> |
|
|
|
305 <outwardlinks description="causes"> |
|
|
|
306 <issuelink> |
|
|
|
307 <issuekey id="100504">MDEV-25924</issuekey> |
|
|
|
308 </issuelink> |
|
|
|
309 <issuelink> |
|
|
|
310 <issuekey id="101102">MDEV-26105</issuekey> |
|
|
|
311 </issuelink> |
|
|
|
312 <issuelink> |
|
|
|
313 <issuekey id="101299">MDEV-26163</issuekey> |
|
|
|
314 </issuelink> |
|
|
|
315 <issuelink> |
|
|
|
316 <issuekey id="101313">MDEV-26165</issuekey> |
|
|
|
317 </issuelink> |
|
|
|
318 <issuelink> |
|
|
|
319 <issuekey id="102745">MDEV-26605</issuekey> |
|
|
|
320 </issuelink> |
|
|
|
321 <issuelink> |
|
|
|
322 <issuekey id="102750">MDEV-26607</issuekey> |
|
|
|
323 </issuelink> |
|
|
|
324 <issuelink> |
|
|
|
325 <issuekey id="104127">MDEV-26863</issuekey> |
|
|
|
326 </issuelink> |
|
|
|
327 </outwardlinks> |
|
|
|
328 </issuelinktype> |
|
|
|
329 <issuelinktype id="10003"> |
|
|
|
330 <name>Relates</name> |
|
|
|
331 <outwardlinks description="relates to"> |
|
|
|
332 <issuelink> |
|
|
|
333 <issuekey id="74138">MDEV-19123</issuekey> |
|
|
|
334 </issuelink> |
|
|
|
335 </outwardlinks> |
|
|
|
336 <inwardlinks description="relates to"> |
|
|
|
337 <issuelink> |
|
|
|
338 <issuekey id="53005">MDEV-8765</issuekey> |
|
|
|
339 </issuelink> |
|
|
|
340 <issuelink> |
|
|
|
341 <issuekey id="70714">MDEV-17662</issuekey> |
|
|
|
342 </issuelink> |
|
|
|
343 <issuelink> |
|
|
|
344 <issuekey id="85348">MDEV-22217</issuekey> |
|
|
|
345 </issuelink> |
|
|
|
346 </inwardlinks> |
|
|
|
347 </issuelinktype> |
|
|
|
348 </issuelinks> |
|
|
|
349 <attachments> |
|
|
|
350 </attachments> |
|
|
|
351 <subtasks> |
|
|
|
352 <subtask id="99728">MDEV-25706</subtask> |
|
|
|
353 </subtasks> |
|
|
|
354 <customfields> |
|
|
|
355 <customfield id="customfield_11700" key="com.atlassian.jira.plugins.jira-development-integration-plugin:devsummary"> |
|
|
|
356 <customfieldname>Development</customfieldname> |
|
|
|
357 <customfieldvalues> |
|
|
|
358 |
|
|
|
359 </customfieldvalues> |
|
|
|
360 </customfield> |
|
|
|
361 <customfield id="customfield_10000" key="com.pyxis.greenhopper.jira:gh-global-rank"> |
|
|
|
362 <customfieldname>Global Rank</customfieldname> |
|
|
|
363 <customfieldvalues> |
|
|
|
364 <customfieldvalue>9223372036854775807</customfieldvalue> |
|
|
|
365 </customfieldvalues> |
|
|
|
366 </customfield> |
|
|
|
367 |
|
|
|
368 <customfield id="customfield_10700" key="com.pyxis.greenhopper.jira:gh-lexo-rank"> |
|
|
|
369 <customfieldname>Rank</customfieldname> |
|
|
|
370 <customfieldvalues> |
|
|
|
371 <customfieldvalue>1|hzul1z:</customfieldvalue> |
|
|
|
372 |
|
|
|
373 </customfieldvalues> |
|
|
|
374 </customfield> |
|
|
|
375 <customfield id="customfield_10300" key="com.pyxis.greenhopper.jira:gh-global-rank"> |
|
|
|
376 <customfieldname>Rank (Obsolete)</customfieldname> |
|
|
|
377 <customfieldvalues> |
|
|
|
378 <customfieldvalue>9223372036854775807</customfieldvalue> |
|
|
|
379 </customfieldvalues> |
|
|
|
380 </customfield> |
|
|
|
381 <customfield id="customfield_12402" key="com.almworks.jira.structure:index-monitor-cf-type"> |
|
|
|
382 <customfieldname>Structure Index Monitor</customfieldname> |
|
|
|
383 <customfieldvalues> |
|
|
|
384 |
|
|
|
385 </customfieldvalues> |
|
|
|
386 </customfield> |
|
|
|
387 <customfield id="customfield_12400" key="com.xiplink.jira.git.jira_git_plugin:gitbranches"> |
|
|
|
388 <customfieldname>gitBranch</customfieldname> |
|
|
|
389 <customfieldvalues> |
|
|
|
390 <customfieldvalue key="$singleValue.optionId">bb-10.2-MDEV26113</customfieldvalue> |
|
|
|
391 <customfieldvalue key="$singleValue.optionId">10.7</customfieldvalue> |
|
|
|
392 |
|
|
|
393 </customfieldvalues> |
|
|
|
394 </customfield> |
|
|
|
395 <customfield id="customfield_12401" key="com.xiplink.jira.git.jira_git_plugin:gitcommitsreferenced"> |
|
|
|
396 <customfieldname>gitCommitsReferenced</customfieldname> |
|
|
|
397 <customfieldvalues> |
|
|
|
398 <customfieldvalue>true</customfieldvalue> |
|
|
|
399 |
|
|
|
400 </customfieldvalues> |
|
|
|
401 </customfield> |
|
|
|
402 <customfield id="customfield_11300" key="com.j-tricks.jql-plugin:jqlt-field"> |
|
|
|
403 <customfieldname>jqltField</customfieldname> |
|
|
|
404 <customfieldvalues> |
|
|
|
405 |
|
|
|
406 </customfieldvalues> |
|
|
|
407 </customfield> |
|
|
|
408 </customfields> |
|
|
|
409 </item> |
|
|
|
410 </channel> |
|
|
|
411 |
|