将窄字符串插入到 std::basic_ostream<wchar_t>

Inserting narrow character string to std::basic_ostream<wchar_t>

本文关键字:gt wchar lt ostream basic 字符串 插入 std      更新时间:2023-10-16

根据cppref, std::basic_ostream<wchar_t>接收const char*, operator <<过载。似乎转换操作只是将每个char拓宽为wchar_t。也就是说,转换(插入)的宽字符的数量等于窄字符的数量。问题来了。狭窄的字符串可能编码国际字符,例如使用GB2312编码的中文字符。进一步假设sizeof(wchar_t)2并使用UTF16编码。那么这种简单的字符转换方法应该如何工作呢?

我刚刚检查了Visual Studio 2015,你是对的。char s只加宽到wchar_t s,没有任何转换。在我看来,你将不得不自己将窄字符串转换为宽字符串。有几种方法可以做到这一点,其中一些已经被建议过了。

在这里,我建议您可以使用纯c++工具来完成它,假设您的c++编译器标准库足够完整(Visual Studio,或Linux上的GCC(仅在那里)):

void clear_mbstate (std::mbstate_t & mbs);
void
towstring_internal (std::wstring & outstr, const char * src, std::size_t size,
    std::locale const & loc)
{
    if (size == 0)
    {
        outstr.clear ();
        return;
    }
    typedef std::codecvt<wchar_t, char, std::mbstate_t> CodeCvt;
    const CodeCvt & cdcvt = std::use_facet<CodeCvt>(loc);
    std::mbstate_t state;
    clear_mbstate (state);
    char const * from_first = src;
    std::size_t const from_size = size;
    char const * const from_last = from_first + from_size;
    char const * from_next = from_first;
    std::vector<wchar_t> dest (from_size);
    wchar_t * to_first = &dest.front ();
    std::size_t to_size = dest.size ();
    wchar_t * to_last = to_first + to_size;
    wchar_t * to_next = to_first;
    CodeCvt::result result;
    std::size_t converted = 0;
    while (true)
    {
        result = cdcvt.in (
            state, from_first, from_last,
            from_next, to_first, to_last,
            to_next);
        // XXX: Even if only half of the input has been converted the
        // in() method returns CodeCvt::ok. I think it should return
        // CodeCvt::partial.
        if ((result == CodeCvt::partial || result == CodeCvt::ok)
            && from_next != from_last)
        {
            to_size = dest.size () * 2;
            dest.resize (to_size);
            converted = to_next - to_first;
            to_first = &dest.front ();
            to_last = to_first + to_size;
            to_next = to_first + converted;
            continue;
        }
        else if (result == CodeCvt::ok && from_next == from_last)
            break;
        else if (result == CodeCvt::error
            && to_next != to_last && from_next != from_last)
        {
            clear_mbstate (state);
            ++from_next;
            from_first = from_next;
            *to_next = L'?';
            ++to_next;
            to_first = to_next;
        }
        else
            break;
    }
    converted = to_next - &dest[0];
    outstr.assign (dest.begin (), dest.begin () + converted);
}
void
clear_mbstate (std::mbstate_t & mbs)
{
    // Initialize/clear mbstate_t type.
    // XXX: This is just a hack that works. The shape of mbstate_t varies
    // from single unsigned to char[128]. Without some sort of initialization
    // the codecvt::in/out methods randomly fail because the initial state is
    // random/invalid.
    std::memset (&mbs, 0, sizeof (std::mbstate_t));
}

这个函数是log4cplus库的一部分,它可以工作。它使用codecvt面来进行转换。你必须给它适当的设置locale

Visual studio可能会在为GB2312适当设置区域设置时出现问题。您可能必须使用_setmbcp()才能使其工作。有关详细信息,请参见"Visual Studio 2015中的双字节字符序列转换问题"。