Update Cursor skipping last row?
.everyoneloves__top-leaderboard:empty,.everyoneloves__mid-leaderboard:empty,.everyoneloves__bot-mid-leaderboard:empty{ margin-bottom:0;
}
I have created a python function within field calculator to calculate the time difference between a timestamp (yyyy-MM-dd HH:mm:ss) in a row and the row after (the interval field in seconds). I have used a update cursor with field calculator to do this, however I am receiving null values for both the first and last row.
The first is correctly missed due to the function being reliant on having a value set by the previous row.
I am unsure as to why the last row is being skipped?
The first row of the attribute is formatted as:
The last:
I have had this issue on several other update cursor functions including those on simple single row condition statements.
Am I missing a statement to close the update cursor loop?
My code is:
import arcpy, time, datetime
from time import strftime
from datetime import timedelta, datetime
from arcpy import da
def FindTime(table,date,interval):
firstRow = True
with arcpy.da.UpdateCursor(table, ["interval", "date"]) as cursor:
for row in cursor:
gap2 = row[1]
if firstRow == True:
gap1 = gap2
firstRow = False
continue
timedelta = gap2 - gap1
row[0] = timedelta.days * 24 * 3600 + timedelta.seconds
gap1 = gap2
cursor.updateRow(row)
*Updated from below comment's solution:
import arcpy
def FindTime(fc, datefield, daydiff_field):
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
arcpy modelbuilder field-calculator cursor python-parser
add a comment |
I have created a python function within field calculator to calculate the time difference between a timestamp (yyyy-MM-dd HH:mm:ss) in a row and the row after (the interval field in seconds). I have used a update cursor with field calculator to do this, however I am receiving null values for both the first and last row.
The first is correctly missed due to the function being reliant on having a value set by the previous row.
I am unsure as to why the last row is being skipped?
The first row of the attribute is formatted as:
The last:
I have had this issue on several other update cursor functions including those on simple single row condition statements.
Am I missing a statement to close the update cursor loop?
My code is:
import arcpy, time, datetime
from time import strftime
from datetime import timedelta, datetime
from arcpy import da
def FindTime(table,date,interval):
firstRow = True
with arcpy.da.UpdateCursor(table, ["interval", "date"]) as cursor:
for row in cursor:
gap2 = row[1]
if firstRow == True:
gap1 = gap2
firstRow = False
continue
timedelta = gap2 - gap1
row[0] = timedelta.days * 24 * 3600 + timedelta.seconds
gap1 = gap2
cursor.updateRow(row)
*Updated from below comment's solution:
import arcpy
def FindTime(fc, datefield, daydiff_field):
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
arcpy modelbuilder field-calculator cursor python-parser
1
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
Edited pasting to SE typo!
– Will
18 hours ago
add a comment |
I have created a python function within field calculator to calculate the time difference between a timestamp (yyyy-MM-dd HH:mm:ss) in a row and the row after (the interval field in seconds). I have used a update cursor with field calculator to do this, however I am receiving null values for both the first and last row.
The first is correctly missed due to the function being reliant on having a value set by the previous row.
I am unsure as to why the last row is being skipped?
The first row of the attribute is formatted as:
The last:
I have had this issue on several other update cursor functions including those on simple single row condition statements.
Am I missing a statement to close the update cursor loop?
My code is:
import arcpy, time, datetime
from time import strftime
from datetime import timedelta, datetime
from arcpy import da
def FindTime(table,date,interval):
firstRow = True
with arcpy.da.UpdateCursor(table, ["interval", "date"]) as cursor:
for row in cursor:
gap2 = row[1]
if firstRow == True:
gap1 = gap2
firstRow = False
continue
timedelta = gap2 - gap1
row[0] = timedelta.days * 24 * 3600 + timedelta.seconds
gap1 = gap2
cursor.updateRow(row)
*Updated from below comment's solution:
import arcpy
def FindTime(fc, datefield, daydiff_field):
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
arcpy modelbuilder field-calculator cursor python-parser
I have created a python function within field calculator to calculate the time difference between a timestamp (yyyy-MM-dd HH:mm:ss) in a row and the row after (the interval field in seconds). I have used a update cursor with field calculator to do this, however I am receiving null values for both the first and last row.
The first is correctly missed due to the function being reliant on having a value set by the previous row.
I am unsure as to why the last row is being skipped?
The first row of the attribute is formatted as:
The last:
I have had this issue on several other update cursor functions including those on simple single row condition statements.
Am I missing a statement to close the update cursor loop?
My code is:
import arcpy, time, datetime
from time import strftime
from datetime import timedelta, datetime
from arcpy import da
def FindTime(table,date,interval):
firstRow = True
with arcpy.da.UpdateCursor(table, ["interval", "date"]) as cursor:
for row in cursor:
gap2 = row[1]
if firstRow == True:
gap1 = gap2
firstRow = False
continue
timedelta = gap2 - gap1
row[0] = timedelta.days * 24 * 3600 + timedelta.seconds
gap1 = gap2
cursor.updateRow(row)
*Updated from below comment's solution:
import arcpy
def FindTime(fc, datefield, daydiff_field):
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
arcpy modelbuilder field-calculator cursor python-parser
arcpy modelbuilder field-calculator cursor python-parser
edited 19 hours ago
Will
asked yesterday
WillWill
674
674
1
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
Edited pasting to SE typo!
– Will
18 hours ago
add a comment |
1
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
Edited pasting to SE typo!
– Will
18 hours ago
1
1
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
Edited pasting to SE typo!
– Will
18 hours ago
Edited pasting to SE typo!
– Will
18 hours ago
add a comment |
1 Answer
1
active
oldest
votes
If your field is type date, code below should work. Last line is not calculated since there is no row after. Or do you want to calculate for example second rows diff as second row-first row?
import arcpy
fc = 'somedates'
datefield = 'date123'
daydiff_field = 'seconddiff_long'
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
#next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
Slower than what approach?
– BERA
yesterday
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
|
show 3 more comments
Your Answer
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "79"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f318213%2fupdate-cursor-skipping-last-row%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
If your field is type date, code below should work. Last line is not calculated since there is no row after. Or do you want to calculate for example second rows diff as second row-first row?
import arcpy
fc = 'somedates'
datefield = 'date123'
daydiff_field = 'seconddiff_long'
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
#next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
Slower than what approach?
– BERA
yesterday
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
|
show 3 more comments
If your field is type date, code below should work. Last line is not calculated since there is no row after. Or do you want to calculate for example second rows diff as second row-first row?
import arcpy
fc = 'somedates'
datefield = 'date123'
daydiff_field = 'seconddiff_long'
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
#next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
Slower than what approach?
– BERA
yesterday
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
|
show 3 more comments
If your field is type date, code below should work. Last line is not calculated since there is no row after. Or do you want to calculate for example second rows diff as second row-first row?
import arcpy
fc = 'somedates'
datefield = 'date123'
daydiff_field = 'seconddiff_long'
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
#next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
If your field is type date, code below should work. Last line is not calculated since there is no row after. Or do you want to calculate for example second rows diff as second row-first row?
import arcpy
fc = 'somedates'
datefield = 'date123'
daydiff_field = 'seconddiff_long'
all_dates = [i[0] for i in arcpy.da.SearchCursor(fc,datefield)]
diff = [(d1-d0).seconds for d0,d1 in zip(all_dates, all_dates[1:])]
givediff = iter(diff)
with arcpy.da.UpdateCursor(fc, daydiff_field) as cursor:
#next(cursor) #uncomment this line if you want to calculate row2 diff as row2-row1, =first row no diff
for row in cursor:
try:
row[0] = next(givediff) #Fetch diffs until list is empty...
cursor.updateRow(row)
except StopIteration: #...then break the cursor
break
edited yesterday
answered yesterday
BERABERA
17.1k62044
17.1k62044
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
Slower than what approach?
– BERA
yesterday
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
|
show 3 more comments
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
Slower than what approach?
– BERA
yesterday
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
3
3
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
This is why I love using SE, I have never used the iter() function before, had to go away and look it up, like it! Is there a performance boost using that approach or was it for convenience?
– Hornbydd
yesterday
3
3
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
Nice! Dont know if there is a performance boost. I use it because it is a simple way of fetching items in a list instead of trying to iterate over a cursor and list at the same time.
– BERA
yesterday
2
2
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
If anything, it will actually be slower, because the table is traversed twice instead of once. But for small tables that may not be an issue.
– Berend
yesterday
1
1
Slower than what approach?
– BERA
yesterday
Slower than what approach?
– BERA
yesterday
1
1
Slower than using just an update cursor, as OP does
– Berend
yesterday
Slower than using just an update cursor, as OP does
– Berend
yesterday
|
show 3 more comments
Thanks for contributing an answer to Geographic Information Systems Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fgis.stackexchange.com%2fquestions%2f318213%2fupdate-cursor-skipping-last-row%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
There is no row[2] in your first try, you only have two fields. Are you trying to fetch the value from next row? That is not possible
– BERA
yesterday
Edited pasting to SE typo!
– Will
18 hours ago