08-23-2017 07:27 AM
I am using the method GetValInteger64("",0) to convert some text (string) user input to a number for use in calculations. The error message seems to indicate that TestStand is taking exception to the zero I am using as the second argument in the parentheses. The API help says to use 0 to specify the default behavior for the option, but doesn't say what the default behavior is. I have also tried 0x0 (No_Options) but I get the same results.
Am I using the wrong method here?
08-23-2017 10:03 AM
If you are trying to convert a string to a numeric I believe you would want to use the Val(String string, [Out] [Boolean isValid]) function.
I think the GetValInteger64() function is for getting the value of a property object that is currently represented as a Signed 64-bit Integer. Furthermore I would guess if you figured out your lookup string error you would just run into another one along the lines of the property object being a string and not the expected numeric.
See GetValInteger64() function here and link option info.