Untaring Transform Adding Directory Based on Pattern in Filename
Background:
I've got 20 or so tar files at about 25G each containing a few million files. The directory structure for these files is not the format it needs to be so I want to fix that. Because of the sheer volume, the more steps I can complete in one sweep the better.
What I've Tried:
What I was hoping to do was a loop over the tar files performing this extraction and transformation:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
However, tar spits out this error which google seems to know very little about:
Invalid transform replacement: back reference out of range
Question:
Any recommendations either how to convince tar to work with my backreferences or to do this in another way that would be able to complete in a reasonable amount of time?
linux regex tar
asked May 15 '18 at 22:55
DanDan
239215
add a comment |
Background:
I've got 20 or so tar files at about 25G each containing a few million files. The directory structure for these files is not the format it needs to be so I want to fix that. Because of the sheer volume, the more steps I can complete in one sweep the better.
What I've Tried:
What I was hoping to do was a loop over the tar files performing this extraction and transformation:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
However, tar spits out this error which google seems to know very little about:
Invalid transform replacement: back reference out of range
Question:
Any recommendations either how to convince tar to work with my backreferences or to do this in another way that would be able to complete in a reasonable amount of time?
linux regex tar
asked May 15 '18 at 22:55
DanDan
239215
add a comment |
Background:
I've got 20 or so tar files at about 25G each containing a few million files. The directory structure for these files is not the format it needs to be so I want to fix that. Because of the sheer volume, the more steps I can complete in one sweep the better.
What I've Tried:
What I was hoping to do was a loop over the tar files performing this extraction and transformation:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
However, tar spits out this error which google seems to know very little about:
Invalid transform replacement: back reference out of range
Question:
Any recommendations either how to convince tar to work with my backreferences or to do this in another way that would be able to complete in a reasonable amount of time?
linux regex tar
asked May 15 '18 at 22:55
DanDan
239215
Background:
I've got 20 or so tar files at about 25G each containing a few million files. The directory structure for these files is not the format it needs to be so I want to fix that. Because of the sheer volume, the more steps I can complete in one sweep the better.
What I've Tried:
What I was hoping to do was a loop over the tar files performing this extraction and transformation:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
However, tar spits out this error which google seems to know very little about:
Invalid transform replacement: back reference out of range
Question:
Any recommendations either how to convince tar to work with my backreferences or to do this in another way that would be able to complete in a reasonable amount of time?
linux regex tar
linux regex tar
asked May 15 '18 at 22:55
DanDan
239215
asked May 15 '18 at 22:55
DanDan
239215
asked May 15 '18 at 22:55
DanDan
239215
asked May 15 '18 at 22:55
DanDan
239215
asked May 15 '18 at 22:55
DanDan
239215
239215
add a comment |
add a comment |
1 Answer
1
active
oldest
votes
Try escaping the parentheses around each group:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
add a comment |
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "3"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1323040%2funtaring-transform-adding-directory-based-on-pattern-in-filename%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Try escaping the parentheses around each group:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
add a comment |
Try escaping the parentheses around each group:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
add a comment |
Try escaping the parentheses around each group:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
Try escaping the parentheses around each group:
tar -xf TX.tar.001 --transform 's,^TX/([a-zA-Z][a-zA-Z]*_([0-9][0-9]-[0-9][0-9]-[0-9][0-9])_[0-9][0-9]-[0-9][0-9]-[0-9][0-9]_.+.[a-zA-Z][a-zA-Z]*),2/1,'
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
answered Jan 8 at 3:37
TheJoshWTheJoshW
1
1
add a comment |
add a comment |
Thanks for contributing an answer to Super User!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fsuperuser.com%2fquestions%2f1323040%2funtaring-transform-adding-directory-based-on-pattern-in-filename%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
