Date: Thu, 10 Jan 2019 21:23:43 +0000
* […] there is little incentive to do that before modules get merged.
Right. Which is why we shouldn’t ask for perfection of the ecosystem before we get started.
From: tooling-bounces_at_[hidden] <tooling-bounces_at_[hidden]> On Behalf Of Corentin
Sent: Thursday, January 10, 2019 1:18 PM
To: WG21 Tooling Study Group SG15 <tooling_at_[hidden]>
Subject: Re: [Tooling] Modules naming
It is a chicken and egg problem.
Integrating modules in build systems will be a tedious endeavor - especially in meta build systems,
and there is little incentive to do that before modules get merged.
It would be rather inconvenient to realize modules are not reasonably consumed by build system _after_ the IS is published.
While having large modularized projects and build systems would be nice, it's a luxury we don't seem to have.
And I think taking a long look at module toolability (both in term of current tools. and in term of the 10 years goals/hopes this group has for tooling) falls in SG15 purview.
While my own experience is limited, I trust this group has enough build system experience and knowledge to foresee eventual issues and correct for them.
We can also extrapolate from the well-known issue of headers name collision that exists and the guidelines that arose from that.
It is important to be explicit about what we mean when we say "implementation experience" when talking about modules because they exist at the border between language and tools
and having compiler implementation experience isn't the whole story.
On Thu, 10 Jan 2019 at 21:39 JF Bastien <cxx_at_[hidden]<mailto:cxx_at_[hidden]>> wrote:
On Thu, Jan 10, 2019 at 11:52 AM Corentin <corentin.jabot_at_[hidden]<mailto:corentin.jabot_at_[hidden]>> wrote:
>
> I suspect it will be a while (several years) before we start to see large projects transitioning fully to modules and consumed as such by tools doing automatic dependency scanning etc.
> My understanding is that there is little large scale implementation experience as far as tooling and build systems are concerned ( there is plenty _compilers_ implementation experience, and some build system implementation (and usage of modules) experience - mostly in build2).
Given your statement above, why is it useful for SG15 to discuss
enforcing mapping? Specifically, how will that discussion be grounded
in facts? It seems to me like facts need a compiler implementation,
and a codebase to try it out on. Feel free to talk about hypotheticals
all you want, but in this case code wins.
I think you want to refocus your approach: what are you trying to
achieve? What's the advantage that SG15 has, which the modules SG and
now EWG don't have? How can SG15 contribute module's success?
> On Thu, 10 Jan 2019 at 18:47 JF Bastien <cxx_at_[hidden]<mailto:cxx_at_[hidden]>> wrote:
>>
>> On Thu, Jan 10, 2019 at 6:53 AM Corentin <corentin.jabot_at_[hidden]<mailto:corentin.jabot_at_[hidden]>> wrote:
>> >
>> > Hello.
>> > I would like to suggest two modules related proposals that I think SG15 should look at.
>> >
>> > - Compiler enforced mapping between module names and module interface file (resource) name.
>>
>> Why does SG15 need to do this, versus someone implementing it in an
>> open-source toolchain, trying it out, and bringing what using it
>> taught them to SG15?
>>
>>
>> > Currently, modules interfaces can be declared in any file - which makes dependency scanning more tedious than it needs to be and have performance implications
>> > (The build system needs to open all files to gather a list of modules) - notably when the build system tries to start building while the dependency graph isn't yet complete.
>> >
>> > Tools ( ide, code servers, indexers, refactoring) may also greatly benefit from an easier way to locate the source file which declares a module.
>> >
>> > The specifics of the mapping are open to bikeshedding. However, I think we would have better luck sticking to something simple like <module identifier> <=> <file name>.<extension>
>> > (The standardese would mention resource identifier rather than filename)
>> >
>> > - A standing document giving guidelines for modules naming.
>> >
>> > The goal is to take everything the community had to learn the hard way about header naming over the past 30 years and apply it to modules by providing a set of guidelines
>> > that could be partially enforced by build system vendors.
>> > Encouraging consistency and uniqueness of module identifiers across the industry is I think a necessary step towards sane package management.
>> > Note that the standard requires uniqueness of modules identifiers within (the standard definition of) a program but says little about a way to ensure this uniqueness.
>> >
>> > Here is a rough draft of what I think would be good guidelines, partially inspired by what is done by other languages facing similar issues.
>> >
>> > Prefix module names with an entity and/or a project name to prevent modules from different companies, entities and projects of declaring the same module names.
>> > Exported top-level namespaces should have a name identic to the project name used as part of the name of the module(s) from which it is exported.
>> > Do not export multiple top-level namespaces
>> > Do not export entities in the global namespace outside of the global module fragment.
>> > Organize modules hierarchically. For example, if both modules example.foo and example.foo.bar exist as part of the public API of example, example.foo should reexport example.foo.bar
>> > Avoid common names such as util and core for module name prefix and top-level namespace names.
>> > Use lower-case module names
>> > Do not use characters outside of the basic source character set in module name identifiers.
>> >
>> > My hope is that these 2 proposals (whose impact on the standard is minimal) would make it easier for current tooling to deal with modules
>> > while making possible for example to design dependency managers and build systems able to work at the module level.
>> >
>> > I'd love to gather feedback and opinions before going further in that direction.
>> > Thanks a lot!
>> >
>> > Corentin
>> >
>> > PS: For a bit of background, I talked about these issues there
>> >
>> > https://cor3ntin.github.io/posts/modules_mapping/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcor3ntin.github.io%2Fposts%2Fmodules_mapping%2F&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827616635&sdata=4ahioISF0bLasCdpTd%2B1Coe0x0pP1aZnUlWMoY2LE%2Bk%3D&reserved=0>
>> > https://cor3ntin.github.io/posts/modules_naming/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcor3ntin.github.io%2Fposts%2Fmodules_naming%2F&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827626648&sdata=0jGMXRsqHoGDOUgZHJYrq1n2gLQTDAvQBxsuQuZUs7k%3D&reserved=0>
>> >
>> >
>> > _______________________________________________
>> > Tooling mailing list
>> > Tooling_at_[hidden]td.org<mailto:Tooling_at_[hidden]>
>> > http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827636651&sdata=MJQk%2BaONDbpFoc2AEf3QdAs1KriJHGqKAHRogoGX2TA%3D&reserved=0>
>> _______________________________________________
>> Tooling mailing list
>> Tooling_at_[hidden]std.org<mailto:Tooling_at_[hidden]>
>> http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827636651&sdata=MJQk%2BaONDbpFoc2AEf3QdAs1KriJHGqKAHRogoGX2TA%3D&reserved=0>
>
> _______________________________________________
> Tooling mailing list
> Tooling_at_[hidden]td.org<mailto:Tooling_at_[hidden]>
> http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827646660&sdata=19Q1F525JoSn9gPCeJBq0BTqh2U089qlK9fEQagKpD8%3D&reserved=0>
_______________________________________________
Tooling mailing list
Tooling_at_[hidden]<mailto:Tooling_at_[hidden]>
http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827646660&sdata=19Q1F525JoSn9gPCeJBq0BTqh2U089qlK9fEQagKpD8%3D&reserved=0>
Right. Which is why we shouldn’t ask for perfection of the ecosystem before we get started.
From: tooling-bounces_at_[hidden] <tooling-bounces_at_[hidden]> On Behalf Of Corentin
Sent: Thursday, January 10, 2019 1:18 PM
To: WG21 Tooling Study Group SG15 <tooling_at_[hidden]>
Subject: Re: [Tooling] Modules naming
It is a chicken and egg problem.
Integrating modules in build systems will be a tedious endeavor - especially in meta build systems,
and there is little incentive to do that before modules get merged.
It would be rather inconvenient to realize modules are not reasonably consumed by build system _after_ the IS is published.
While having large modularized projects and build systems would be nice, it's a luxury we don't seem to have.
And I think taking a long look at module toolability (both in term of current tools. and in term of the 10 years goals/hopes this group has for tooling) falls in SG15 purview.
While my own experience is limited, I trust this group has enough build system experience and knowledge to foresee eventual issues and correct for them.
We can also extrapolate from the well-known issue of headers name collision that exists and the guidelines that arose from that.
It is important to be explicit about what we mean when we say "implementation experience" when talking about modules because they exist at the border between language and tools
and having compiler implementation experience isn't the whole story.
On Thu, 10 Jan 2019 at 21:39 JF Bastien <cxx_at_[hidden]<mailto:cxx_at_[hidden]>> wrote:
On Thu, Jan 10, 2019 at 11:52 AM Corentin <corentin.jabot_at_[hidden]<mailto:corentin.jabot_at_[hidden]>> wrote:
>
> I suspect it will be a while (several years) before we start to see large projects transitioning fully to modules and consumed as such by tools doing automatic dependency scanning etc.
> My understanding is that there is little large scale implementation experience as far as tooling and build systems are concerned ( there is plenty _compilers_ implementation experience, and some build system implementation (and usage of modules) experience - mostly in build2).
Given your statement above, why is it useful for SG15 to discuss
enforcing mapping? Specifically, how will that discussion be grounded
in facts? It seems to me like facts need a compiler implementation,
and a codebase to try it out on. Feel free to talk about hypotheticals
all you want, but in this case code wins.
I think you want to refocus your approach: what are you trying to
achieve? What's the advantage that SG15 has, which the modules SG and
now EWG don't have? How can SG15 contribute module's success?
> On Thu, 10 Jan 2019 at 18:47 JF Bastien <cxx_at_[hidden]<mailto:cxx_at_[hidden]>> wrote:
>>
>> On Thu, Jan 10, 2019 at 6:53 AM Corentin <corentin.jabot_at_[hidden]<mailto:corentin.jabot_at_[hidden]>> wrote:
>> >
>> > Hello.
>> > I would like to suggest two modules related proposals that I think SG15 should look at.
>> >
>> > - Compiler enforced mapping between module names and module interface file (resource) name.
>>
>> Why does SG15 need to do this, versus someone implementing it in an
>> open-source toolchain, trying it out, and bringing what using it
>> taught them to SG15?
>>
>>
>> > Currently, modules interfaces can be declared in any file - which makes dependency scanning more tedious than it needs to be and have performance implications
>> > (The build system needs to open all files to gather a list of modules) - notably when the build system tries to start building while the dependency graph isn't yet complete.
>> >
>> > Tools ( ide, code servers, indexers, refactoring) may also greatly benefit from an easier way to locate the source file which declares a module.
>> >
>> > The specifics of the mapping are open to bikeshedding. However, I think we would have better luck sticking to something simple like <module identifier> <=> <file name>.<extension>
>> > (The standardese would mention resource identifier rather than filename)
>> >
>> > - A standing document giving guidelines for modules naming.
>> >
>> > The goal is to take everything the community had to learn the hard way about header naming over the past 30 years and apply it to modules by providing a set of guidelines
>> > that could be partially enforced by build system vendors.
>> > Encouraging consistency and uniqueness of module identifiers across the industry is I think a necessary step towards sane package management.
>> > Note that the standard requires uniqueness of modules identifiers within (the standard definition of) a program but says little about a way to ensure this uniqueness.
>> >
>> > Here is a rough draft of what I think would be good guidelines, partially inspired by what is done by other languages facing similar issues.
>> >
>> > Prefix module names with an entity and/or a project name to prevent modules from different companies, entities and projects of declaring the same module names.
>> > Exported top-level namespaces should have a name identic to the project name used as part of the name of the module(s) from which it is exported.
>> > Do not export multiple top-level namespaces
>> > Do not export entities in the global namespace outside of the global module fragment.
>> > Organize modules hierarchically. For example, if both modules example.foo and example.foo.bar exist as part of the public API of example, example.foo should reexport example.foo.bar
>> > Avoid common names such as util and core for module name prefix and top-level namespace names.
>> > Use lower-case module names
>> > Do not use characters outside of the basic source character set in module name identifiers.
>> >
>> > My hope is that these 2 proposals (whose impact on the standard is minimal) would make it easier for current tooling to deal with modules
>> > while making possible for example to design dependency managers and build systems able to work at the module level.
>> >
>> > I'd love to gather feedback and opinions before going further in that direction.
>> > Thanks a lot!
>> >
>> > Corentin
>> >
>> > PS: For a bit of background, I talked about these issues there
>> >
>> > https://cor3ntin.github.io/posts/modules_mapping/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcor3ntin.github.io%2Fposts%2Fmodules_mapping%2F&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827616635&sdata=4ahioISF0bLasCdpTd%2B1Coe0x0pP1aZnUlWMoY2LE%2Bk%3D&reserved=0>
>> > https://cor3ntin.github.io/posts/modules_naming/<https://nam06.safelinks.protection.outlook.com/?url=https%3A%2F%2Fcor3ntin.github.io%2Fposts%2Fmodules_naming%2F&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827626648&sdata=0jGMXRsqHoGDOUgZHJYrq1n2gLQTDAvQBxsuQuZUs7k%3D&reserved=0>
>> >
>> >
>> > _______________________________________________
>> > Tooling mailing list
>> > Tooling_at_[hidden]td.org<mailto:Tooling_at_[hidden]>
>> > http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827636651&sdata=MJQk%2BaONDbpFoc2AEf3QdAs1KriJHGqKAHRogoGX2TA%3D&reserved=0>
>> _______________________________________________
>> Tooling mailing list
>> Tooling_at_[hidden]std.org<mailto:Tooling_at_[hidden]>
>> http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827636651&sdata=MJQk%2BaONDbpFoc2AEf3QdAs1KriJHGqKAHRogoGX2TA%3D&reserved=0>
>
> _______________________________________________
> Tooling mailing list
> Tooling_at_[hidden]td.org<mailto:Tooling_at_[hidden]>
> http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827646660&sdata=19Q1F525JoSn9gPCeJBq0BTqh2U089qlK9fEQagKpD8%3D&reserved=0>
_______________________________________________
Tooling mailing list
Tooling_at_[hidden]<mailto:Tooling_at_[hidden]>
http://www.open-std.org/mailman/listinfo/tooling<https://nam06.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.open-std.org%2Fmailman%2Flistinfo%2Ftooling&data=02%7C01%7Cgdr%40microsoft.com%7C50b0d4ca0e2a470bb25608d6774119dc%7C72f988bf86f141af91ab2d7cd011db47%7C1%7C0%7C636827518827646660&sdata=19Q1F525JoSn9gPCeJBq0BTqh2U089qlK9fEQagKpD8%3D&reserved=0>
Received on 2019-01-10 22:23:47