C++ Logo

sg15

Advanced search

Re: [isocpp-ext] Can we expect that all C++ source files can have the same suffix?

From: Nico Josuttis <nico_at_[hidden]>
Date: Sun, 17 Apr 2022 17:45:49 +0200
The programmers who care in my trainings are all in big projects.
But before they start they want to learn and try out thing on small examples.

How important smal examples are, you can see with the success of compiler explorer.

BTW, a key benefit is that we can more or less concat multiple header and source files and test them as one file.

THIS is a feature I also desperately miss with modules.
Does abybody know a trick to combine all files using modules in one file?
Shouldn't we support that in C++?

(may be time for yet another script... 😂)

Am 17. April 2022 16:43:14 MESZ schrieb Patrice Roy via Ext <ext_at_[hidden]>:
>I don't want to veer into SG20 territory, but I think we should avoid such
>blanket statements, especially in academic / learning settings or about
>students themselves. Situations are diverse here as they are with C++ users
>in general.
>
>It is indeed important to use build systems, and using C++ at scale
>assuredly involves them, but if we want newcomers to use C++ and understand
>what they are doing, we definitely want it to be possible to write small
>C++ programs and compile them easily through the command line. Among other
>things, as René Ferdinand reminded us, it helps students understand more
>complex tools better.
>
>I'm not convinced standardizing module extensions is really an issue, but
>let's keep this in mind. It's important that C++ remains usable (if only
>for learners) as is, with a terminal and a compiler (and yes, they should
>learn to use build systems, but both are important).
>
>Le sam. 16 avr. 2022 à 14:41, Daniel Ruoso via SG15 <sg15_at_[hidden]>
>a écrit :
>
>> I, personally, think it's time to get over the expectation that it's
>> realistic to use c++ without a build system.
>>
>> Especially in teaching context, we should prepare folks to the real world,
>> which necessarily involves a build system, instead of creating this
>> anachronistic requirements.
>>
>> Daniel
>>
>> On Sat, Apr 16, 2022, 14:30 Gabriel Dos Reis via SG15 <
>> sg15_at_[hidden]> wrote:
>>
>>> Thanks, Daniela.
>>>
>>>
>>>
>>> - So Nico, what is it what you are looking for?
>>>
>>>
>>>
>>> I’ve come to the same conclusion after being (privately) abused by Nico –
>>> yes, I answered him on many occasions (including in-person in Prague). My
>>> hope is that the wider audience is able to help suss out the actual
>>> technical problem that has a solution that scales beyond nice slide
>>> presentations.
>>>
>>>
>>>
>>> -- Gaby
>>>
>>>
>>>
>>> *From:* Ext <ext-bounces_at_[hidden]> *On Behalf Of *Daniela Engert
>>> via Ext
>>> *Sent:* Saturday, April 16, 2022 5:06 AM
>>> *To:* ext_at_[hidden]; sg15_at_[hidden]
>>> *Cc:* dani <dani_at_[hidden]>
>>> *Subject:* Re: [isocpp-ext] [SG15] Can we expect that all C++ source
>>> files can have the same suffix?
>>>
>>>
>>>
>>> Hi Nico,
>>>
>>>
>>>
>>> having read all the messages on the respective reflectors, our private
>>> conversations and social media, I'm still having trouble to see what you're
>>> after.
>>>
>>>
>>>
>>> Neither msvc (the compiler) nor MSBuild (the build system) nor
>>> VisualStudio (the IDE with its project system) requires any particular file
>>> extension whatsoever to work with modules. In fact, in the beginning when I
>>> started seriously investigating this modules thing in 2018, I was uniformly
>>> using the .cpp extension with msvc and clang. A year later during my
>>> modularization of the {fmt} library I've switched to .cc for the module
>>> interface unit because it is the coding convention for all C++ TUs in
>>> {fmt}. And both msvc and cmake were happy with it (and still are). And
>>> since we have modules in production and active development at my workplace,
>>> we conventionally settled on .ixx for the PMIU and kept .cpp for everything
>>> else. This turned out to be the most convenient and practical convention
>>> *in that particular environment* using *the given toolset* and with
>>> cross-platform considerations totally being a non-issue. This .ixx
>>> extension for the PMIUs is in no way mandated by any component involved
>>> there, I could use .cpp just as well as I did in the beginning. But I
>>> appreciate .ixx for the module interfaces simply because they are so
>>> pivotal in understanding a module and thus better stand out of the sea of
>>> other TUs on the first glance just due to the different shape of the glyphs.
>>>
>>>
>>>
>>> From my understanding of other compilers, this is just the same with
>>> them. The real issue is with the build tools that drive the whole
>>> compilation process. As a user, I don't actually care about the incantation
>>> ceremonies required by compilers, versions, modes etc. This is what MSBuild
>>> and the module dependency scanner are taking care of in my development
>>> environment. Or CMake might provide in the future. Or any other tool for
>>> that matter.
>>>
>>>
>>>
>>> But my biggest beef with the state of the ecosystem is the total lack of
>>> understanding of the module semantics by tools like static code analysers
>>> and such. My daily experience with them is like I'm talking Plankalkül to
>>> them instead of post-post-post modern C++. 🙂
>>>
>>>
>>>
>>> So Nico, what is it what you are looking for? It can't be only the file
>>> extension given the many of them that are already in existence and use
>>> during the past couple of decades.
>>>
>>>
>>>
>>> Ciao
>>> Dani
>>>
>>>
>>>
>>>
>>>
>>> Am 16.04.2022 um 12:53 schrieb Nico Josuttis via Ext:
>>>
>>> Hi Roger,
>>> I agree.
>>> However, cmake and other tools use the command line. So, they would have
>>> these problems solved.
>>>
>>> Even for Visual Studio, if there is support for arbitrary file extensions
>>> and no need for specific command line options, code coming from different
>>> compiler can just be used as it is.
>>> So, programmers could have all files with suffix .cpp (as is fine for
>>> gcc) and just add them to the Visual Studio project without further action.
>>>
>>> While of course VC++ still can reommend special suffixes like .ixx (still
>>> I don't know the suffix for internal partitions), the other compilers would
>>> not have to adopt their convention and the community will decide which
>>> suffix "wins" (as it happened with ".cpp" which came from a Microsoft,
>>> although strangly it is not used by them in a modified form for modules).
>>>
>>> I will today publish a script that fix the problems Visual Studio has
>>> with module files for the command line. That way, programmers can write
>>> their first portable module programm... (portable in the practical not
>>> formal sense, Gaby).
>>>
>>> As usual, correct me if I miss something.
>>>
>>> Am 16. April 2022 12:10:03 MESZ schrieb Roger Orr via Ext
>>> <ext_at_[hidden]> <ext_at_[hidden]>:
>>>
>>> Hello Nico,
>>>
>>> I am slightly puzzled by the use of 'command line' and 'command' in your email.
>>>
>>>
>>>
>>> In my own experience I suspect few of the C++ programmers I work with ever compile with a command line; they either work within an IDE or run a build script, likely using cmake. It us unclear to me what is the benefit of seeking a unified command line that most programmers are not even aware of.
>>>
>>>
>>>
>>> Regards,
>>>
>>> Roger.
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> -----Original Message-----
>>>
>>> From: Ext [mailto:ext-bounces_at_[hidden] <ext-bounces_at_[hidden]>] On Behalf Of Nico Josuttis via Ext
>>>
>>> Sent: 16 April 2022 07:43
>>>
>>> To: Gabriel Dos Reis; ext_at_[hidden]; sg15_at_[hidden]
>>>
>>> Cc: Nico Josuttis; Nathan Sidwell
>>>
>>> Subject: Re: [isocpp-ext] [SG15] Can we expect that all C++ source files can have the same suffix?
>>>
>>>
>>>
>>>
>>>
>>> Gaby,
>>>
>>>
>>>
>>> you want me to tell programmers that we have portable examples, for which unfortunately there is not defined HOW to deal with them?
>>>
>>> And selling this as "you can use modules in practice"? 🤔
>>>
>>>
>>>
>>> Of course for programmers a portable program implies that
>>>
>>> a) I don't have to rename files
>>>
>>> b) I don't have to use different conmand-line options for files having the same suffix
>>>
>>> c) I can compile all code with a single command
>>>
>>>
>>>
>>> Once we have that, we can teach content and programmers will use it. So far, the clear conclusion is that you cannot use modules in practice.
>>>
>>>
>>>
>>> It would be absolutely no problem to provide that for Visual C++. Ideally ignoring file extensions and analyze C++ file content.
>>>
>>> Therefore, I wonder why you do not WANT that (and at the same time tell that you are interesting that modules become widely used).
>>>
>>>
>>>
>>> And, BTW, I am desperately looking for the file extension Visual C++ expect for internal patition units
>>>
>>> (to skip /internalPartition).
>>>
>>> PLEASE just tell us.
>>>
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Am 15. April 2022 21:46:13 MESZ schrieb Gabriel Dos Reis <gdr_at_[hidden]> <gdr_at_[hidden]>:
>>>
>>> Fortunately, there IS a portable C++ example of “hello world” program,
>>>
>>> today.
>>>
>>>
>>>
>>> *How* to compile a given source file has always depended on compilers,
>>>
>>> their environment of invocations, and supporting toolsets. That won’t
>>>
>>> change. And Modules don’t have a goal of changing that.
>>>
>>>
>>>
>>> Requiring that the set of satellite files that a compiler has to produce depends solely on the contents of the source file, and not on the invocation command lines, isn’t going to work in real world, production environments. That is what build systems are for, to abstract over the details. My hope is that professional teaching of programming with modules direct C++ programmers to relying on their build systems.
>>>
>>>
>>>
>>> We are having a conversation in SG15 about common ways of describing to
>>>
>>> build systems what are the needs of a program and library, and let the
>>>
>>> build system make the build happens. And that is not restricted to
>>>
>>> modules, even though they make the conversation urgent.
>>>
>>>
>>>
>>> -- Gaby
>>>
>>>
>>>
>>> From: Nico Josuttis <nico_at_[hidden]> <nico_at_[hidden]>
>>>
>>> Sent: Friday, April 15, 2022 12:05 PM
>>>
>>> To: ext_at_[hidden]; Gabriel Dos Reis via Ext
>>>
>>> <ext_at_[hidden]> <ext_at_[hidden]>; ext_at_[hidden]; sg15_at_[hidden]
>>>
>>> Cc: Gabriel Dos Reis <gdr_at_[hidden]> <gdr_at_[hidden]>; Nathan Sidwell <nathan_at_[hidden]> <nathan_at_[hidden]>
>>>
>>> Subject: Re: [isocpp-ext] [SG15] Can we expect that all C++ source files can have the same suffix?
>>>
>>>
>>>
>>> haha,
>>>
>>> I REALLY would like to have the first portable "hello module" example.
>>>
>>>
>>>
>>> Currently, there is simply no way to have it. That's really a shame.
>>>
>>>
>>>
>>>
>>>
>>> Am 15. April 2022 20:46:59 MESZ schrieb Gabriel Dos Reis via Ext
>>>
>>> <ext_at_[hidden]<mailto:ext_at_[hidden]> <ext_at_[hidden]>>:
>>>
>>>
>>>
>>> Nathan - you recount is all correct.
>>>
>>>
>>>
>>> I know I've mentioned it more than once, but I find it unsettling,
>>>
>>> given there was great opposition to there being a (two way?) mapping
>>>
>>> between file names and module names, that there is a move in the
>>>
>>> direction of making file names 'significant'. ISTM that the desire for
>>>
>>> bob.$REGULARSUFFIX and alice.$MODULESUFFIX is taking us all the way
>>>
>>> back to the first objection above about having two languages.
>>>
>>>
>>>
>>> I am not seeing any movement to make filename suffixes significant in
>>>
>>> the linguistic interpretation, by the compiler, of the content of
>>>
>>> source file. Maybe I am not looking right; but I would definitely
>>>
>>> recommend against such move. There are extra linguistic considerations
>>>
>>> that might force a toolset (not just a compiler) to require certain
>>>
>>> suffixes, but those suffixes do not determine the meaning a C++ program
>>>
>>> -- this is not different from compilers like GCC or MSVC refusing to
>>>
>>> compile in default mode files ending with ".h" or similar because they
>>>
>>> generally have other connotations.
>>>
>>>
>>>
>>> For some reasons, the topic of the "right" suffix seems to generate
>>>
>>> more passion than the topic of what can we do with modules, so maybe we
>>>
>>> are already doing a lot with modules 😝
>>>
>>>
>>>
>>> -- Gaby
>>>
>>>
>>>
>>> -----Original Message-----
>>>
>>> From: Ext
>>>
>>> <ext-bounces_at_[hidden]<mailto:ext-bounces_at_[hidden]> <ext-bounces_at_[hidden]>> On Behalf Of Nathan Sidwell via Ext
>>>
>>> Sent: Friday, April 15, 2022 11:21 AM
>>>
>>> To: sg15_at_[hidden]<mailto:sg15_at_[hidden]> <sg15_at_[hidden]>; ext_at_[hidden]<mailto:ext_at_[hidden]> <ext_at_[hidden]>; WG21 Tooling Study Group SG15 <tooling_at_[hidden]<mailto:tooling_at_[hidden]> <tooling_at_[hidden]>>
>>>
>>> Cc: Nathan Sidwell <nathan_at_[hidden]<mailto:nathan_at_[hidden]> <nathan_at_[hidden]>>
>>>
>>> Subject: Re: [isocpp-ext] [SG15] Can we expect that all C++ source files can have the same suffix?
>>>
>>>
>>>
>>> On 4/13/22 17:10, Nico Josuttis via SG15 wrote:
>>>
>>>
>>>
>>> I should add that the fact that we need
>>>
>>> module;
>>>
>>> at the beginning of the global module fragment was only introduced to
>>>
>>> let a file identify itself as module file. If we would require
>>>
>>> different suffixes, that would not have been necessary.
>>>
>>>
>>>
>>> But correct me if I am wrong.
>>>
>>>
>>>
>>> I shall correct you :)
>>>
>>>
>>>
>>> Here's the history (as I recall, all persons mentioned are real, and
>>>
>>> not to be confused with ficticious characters)
>>>
>>>
>>>
>>> * prior to me doing things with gcc, there was only 'module FOO;' as a
>>>
>>> module declaration at-most once within a TU. MSVC (the only compiler
>>>
>>> with module smarts at the time), had a flag to tell it 'this is an
>>>
>>> interface' vs 'this is an implementation'.
>>>
>>>
>>>
>>> * I found this unsatisfying, as it meant that there was something
>>>
>>> outside the source tokens that told you how to interpret them. In
>>>
>>> effect we had two languages.
>>>
>>>
>>>
>>> * IIRC, Gaby, Jason (Merrill) and I came up with the 'export module
>>>
>>> FOO;' vs 'module foo;' distinction. But still this could be anywhere
>>>
>>> in the source stream. I was able to implement this functionality to a
>>>
>>> working system.
>>>
>>>
>>>
>>> * Daveed proposed an early signifier of 'hey, this is gonna be a
>>>
>>> module', should the actual module declaration not be first. Hence
>>>
>>> 'module;' was born. (My understanding was that this was driven by
>>>
>>> implementors, as they had difficulty entering a module-like mode not at
>>>
>>> start of compilation, and indeed it was a little tricky to do that. I
>>>
>>> do not know if this was also a user request.)
>>>
>>>
>>>
>>> * post p1103, the requirement that everything between 'module;' and the
>>>
>>> module decl come from #include came to be.
>>>
>>>
>>>
>>> Hope that helps.
>>>
>>>
>>>
>>> I know I've mentioned it more than once, but I find it unsettling,
>>>
>>> given there was great opposition to there being a (two way?) mapping
>>>
>>> between file names and module names, that there is a move in the
>>>
>>> direction of making file names 'significant'. ISTM that the desire for
>>>
>>> bob.$REGULARSUFFIX and alice.$MODULESUFFIX is taking us all the way
>>>
>>> back to the first objection above about having two languages.
>>>
>>>
>>>
>>> nathan
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> Am 13. April 2022 22:58:13 MESZ schrieb Nicolai Josuttis via Ext
>>>
>>> <ext_at_[hidden]<mailto:ext_at_[hidden]> <ext_at_[hidden]>>:
>>>
>>>
>>>
>>> What I teach about modules is compelling. Programmers like and want to use it.
>>>
>>> However, they ask how they should organize module files in
>>>
>>> practice.
>>>
>>>
>>>
>>> So far I cannot recommend a specific suffix (and I might never be able to do
>>>
>>> that).
>>>
>>> However there is one important question that IMO the standard should answer:
>>>
>>> *Do we **/need /**different suffixes?*
>>>
>>>
>>>
>>> I understand that a suffix discussion is only of practical value.
>>>
>>> But IMO the standard has to give an answer here (which has nothing to do
>>>
>>> with which suffixes are used).
>>>
>>>
>>>
>>> Let me elaborate that in detail:
>>>
>>>
>>>
>>> Not having a standard suffix has interesting consequences.
>>>
>>> So far we have header files and translation units.
>>>
>>> But once we know what a C++ translation unit is, we can just compile them
>>>
>>> all with the same compiler options or commands. Because in practice we have
>>>
>>> different suffixes for header and source files, we can set-up generic rules
>>>
>>> to compile our code.
>>>
>>>
>>>
>>> This works for any suffix, provided you know the way to tell the compiler
>>>
>>> that we have a C++ file here:
>>>
>>> (use /Tp with VC++ and -xc++ with gcc and you are done).
>>>
>>>
>>>
>>> Is this still true with modules?
>>>
>>> That is: Can we expect that identifying a file as C++ file is enough to be
>>>
>>> able to (pre) compile it as C++ file?
>>>
>>>
>>>
>>> Current compilers give different answers (AFAIK):
>>>
>>>
>>>
>>> - *gcc *says the same suffix is possible. There is not special option for
>>>
>>> modules.
>>>
>>> I can still have my own suffixes and use -xc++ though.
>>>
>>>
>>>
>>> - *VC++* currently requires different suffixes or different command-line
>>>
>>> arguments.
>>>
>>> Identifying a file as C++ file is not enough.
>>>
>>> For example
>>>
>>> - This is not enough: /Tp mymod.cppm
>>>
>>> - You need: /interface /Tp mymod.cppm
>>>
>>>
>>>
>>> I wonder whether the behavior of VC++ is standard conforming.
>>>
>>>
>>>
>>> I see no place in the C++ standard saying that there has to be different
>>>
>>> treatment of C++ source files to make them work.
>>>
>>> Or do we require this somewhere?
>>>
>>> We do not require different treatment just because we have templates,
>>>
>>> namespaces, or exceptions used inside.
>>>
>>> Therefore, I would expect that also using modules does not require special
>>>
>>> handling.
>>>
>>> (This is independent from the question whether different suffixes help to
>>>
>>> deal with these files).
>>>
>>>
>>>
>>> If I am right, VC++ is not standard conforming.
>>>
>>>
>>>
>>>
>>>
>>> In any case it would help a lot to clarify:
>>>
>>> Can all C++ source files expect that treating them the same way
>>>
>>> works fine?
>>>
>>>
>>>
>>> If not, we obviously need different suffixes. But then we should clearly say
>>>
>>> so (without necessarily saying which suffix it is).
>>>
>>>
>>>
>>>
>>>
>>> I hope this questions brings us a bit forward to be able teach the first
>>>
>>> *portable *"hello, modules" example.
>>>
>>>
>>>
>>> Thanks
>>>
>>>
>>>
>>> Nico
>>>
>>>
>>>
>>>
>>>
>>> --
>>> PGP/GPG: 2CCB 3ECB 0954 5CD3 B0DB 6AA0 BA03 56A1 2C4638C5
>>> _______________________________________________
>>> SG15 mailing list
>>> SG15_at_[hidden]
>>> https://lists.isocpp.org/mailman/listinfo.cgi/sg15
>>>
>> _______________________________________________
>> SG15 mailing list
>> SG15_at_[hidden]
>> https://lists.isocpp.org/mailman/listinfo.cgi/sg15
>>

-- 
Nico Josuttis
(sent from my mobile phone) 

Received on 2022-04-17 15:45:53