Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

8298647: GenShen require heap size 2MB granularity #202

Closed
wants to merge 3 commits into from

Conversation

stooart-mon
Copy link
Contributor

@stooart-mon stooart-mon commented Jan 16, 2023

Generational Shenandoah requires 2MB granularity in order for card tables to cover the allocated heap. Each byte in a page of card table represents 512 heap bytes. As card tables are allocated 4KB at a time, 4KB * 512 = 2MB.

There is a circular dependency between the region calculations and the heap size calculations. This unconditionally rounds up the heap size to 2MB. It might be preferable to do this only when generational mode is enabled.

Running with:
java -Xlog:gc*=trace -XX:+UseShenandoahGC -mx495m
-XX:ShenandoahGCMode=generational -version

on a debug build is sufficient to reproduce this problem.


Progress

  • Change must not contain extraneous whitespace
  • Change must be properly reviewed (1 review required, with at least 1 Committer)

Issue

  • JDK-8298647: GenShen require heap size 2MB granularity

Reviewers

Reviewing

Using git

Checkout this PR locally:
$ git fetch https://git.openjdk.org/shenandoah pull/202/head:pull/202
$ git checkout pull/202

Update a local copy of the PR:
$ git checkout pull/202
$ git pull https://git.openjdk.org/shenandoah pull/202/head

Using Skara CLI tools

Checkout this PR locally:
$ git pr checkout 202

View PR using the GUI difftool:
$ git pr show -t 202

Using diff file

Download this PR as a diff file:
https://git.openjdk.org/shenandoah/pull/202.diff

Generational Shenandoah requires 2MB granularity in order for card
tables to cover the allocated heap. Each byte in a page of card table
represents 512 heap bytes. As card tables are allocated 4KB at a time,
4KB * 512 = 2MB.

There is a circular dependency between the region calculations and the
heap size calculations. This unconditionally rounds up the heap size to
2MB. It might be preferable to do this only when generational mode is
enabled.

Running with:
  java -Xlog:gc*=trace -XX:+UseShenandoahGC -mx495m \
       -XX:ShenandoahGCMode=generational -version

on a debug build is sufficient to reproduce this problem.
@bridgekeeper
Copy link

bridgekeeper bot commented Jan 16, 2023

👋 Welcome back smonteith! A progress list of the required criteria for merging this PR into master will be added to the body of your pull request. There are additional pull request commands available for use with this pull request.

@openjdk openjdk bot added the rfr Pull request is ready for review label Jan 16, 2023
@mlbridge
Copy link

mlbridge bot commented Jan 16, 2023

Webrevs

@@ -724,6 +725,9 @@ size_t ShenandoahHeapRegion::setup_sizes(size_t max_heap_size) {
FLAG_SET_DEFAULT(ShenandoahMinRegionSize, MIN_REGION_SIZE);
}

// Generational Shenandoah needs this alignment for card tables.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this fix! It would be nice if this constraint were only applied for generation mode, but these sizes are computed quite earlier during startup. You'd need to factor the code out of ShenandoahHeap::initialize_heuristics to know whether the constraint is required at this point.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, I thought I'd start with a simple fix to highlight the problem first. I experimented with exactly what you suggested, parsing ShenandoahGCMode. I can update this the 2MB alignment isn't desired unconditionally.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes please. We've tried to limit the impact of the generational mode on Shenandoah's other modes.

Only round up for the card table alignment when generational mode is
enabled.
Copy link
Contributor

@earthling-amzn earthling-amzn left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you for this contribution!

@openjdk
Copy link

openjdk bot commented Jan 23, 2023

@stooart-mon This change now passes all automated pre-integration checks.

ℹ️ This project also has non-automated pre-integration requirements. Please see the file CONTRIBUTING.md for details.

After integration, the commit message for the final commit will be:

8298647: GenShen require heap size 2MB granularity

Reviewed-by: wkemper

You can use pull request commands such as /summary, /contributor and /issue to adjust it as needed.

At the time when this comment was updated there had been no new commits pushed to the master branch. If another commit should be pushed before you perform the /integrate command, your PR will be automatically rebased. If you prefer to avoid any potential automatic rebasing, please check the documentation for the /integrate command for further details.

As you do not have Committer status in this project an existing Committer must agree to sponsor your change. Possible candidates are the reviewers of this PR (@earthling-amzn) but any other Committer may sponsor as well.

➡️ To flag this PR as ready for integration with the above commit message, type /integrate in a new comment. (Afterwards, your sponsor types /sponsor in a new comment to perform the integration).

@openjdk openjdk bot added the ready Pull request is ready to be integrated label Jan 23, 2023
@stooart-mon
Copy link
Contributor Author

/integrate

@openjdk openjdk bot added the sponsor Pull request is ready to be sponsored label Jan 23, 2023
@openjdk
Copy link

openjdk bot commented Jan 23, 2023

@stooart-mon
Your change (at version cd1fea8) is now ready to be sponsored by a Committer.

@earthling-amzn
Copy link
Contributor

/sponsor

@openjdk
Copy link

openjdk bot commented Jan 24, 2023

Going to push as commit 800c0c8.

@openjdk openjdk bot added the integrated Pull request has been integrated label Jan 24, 2023
@openjdk openjdk bot closed this Jan 24, 2023
@openjdk openjdk bot removed ready Pull request is ready to be integrated rfr Pull request is ready for review sponsor Pull request is ready to be sponsored labels Jan 24, 2023
@openjdk
Copy link

openjdk bot commented Jan 24, 2023

@earthling-amzn @stooart-mon Pushed as commit 800c0c8.

💡 You may see a message that your pull request was closed with unmerged commits. This can be safely ignored.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
integrated Pull request has been integrated
2 participants